Contribution to the handbook
Priority · Assessed 2026-10-27
This concerns a material design choice: what affected people, reviewers, or specialists need to understand for a public decision to be scrutinized. The evidence distinguishes knowing a system’s broad purpose from being able to examine its decision factors; it also raises risks of opacity, specialist dependence, and resistance to requirements. The proposed reviewability limit is a draft proposal, not an established or approved policy. [draft-proposal-5-8af0ce96ba9e; s-danaher-threat-of-algocracy-2ee98f663bd9d4a9; s-danaher-threat-of-algocracy-a8775498557d01df; s-danaher-threat-of-algocracy-8c045da597215846]
Does this challenge the goal?
In-scope gap
The question seeks a practical threshold for public understanding of algorithms, a detail within the exploration’s existing focus on citizen participation, scrutiny, and accountability. It does not contest those aims.
The packet reports normative arguments for understanding and scrutiny but does not settle the threshold or establish that one standard fits every decision.
Why this category?
- material design choice
- citizen scrutiny
- risks and limits
- implementation tradeoffs
The sources share a common Danaher source root, and most are AI interpretations of that source rather than independent findings. The proposal’s measurement and enforcement questions remain open; the packet does not establish a settled legal standard.
This is an AI assessment of contribution to the goal, separate from whether the question has an answer.
- How could a human-understandability requirement for public algorithms be measured and enforced without making specialists the sole reviewers or needlessly forfeiting useful systems?
- How much must people understand about an algorithm used in public decisions?
- Can people understand why a data-mining system reaches a result?
- What makes a public decision-making process acceptable to those affected?
- Why does the author think growing reliance on algorithms could make public decisions harder to take part in or understand?
- What conditions does the author say decision-making procedures must meet to be legitimate?
- What kind of understanding should people have to take part in public decisions?
- Why do warehouse workers depend on the algorithm, even if they understand its broad purpose?
- What levels of human control does the author distinguish?
- Would preserving a human decision-maker be enough?
- Why might people struggle to understand an algorithmic system?
- What could make rules requiring understandable AI systems difficult to adopt?
- A human presence may not be enough
- People need to examine the factors
- Understanding the reasons
- People need to understand the process
- Rules may face resistance
- Some systems are hard to explain
- Specialist explanations may not be enough
- Complex systems are hard to understand
- Workers hand over the details
- Why the process matters
- Understanding may be the deeper problem
- Participation and understanding matter
- Reasons for choices are unclear
Making and interpreting laws →
Judging situations and resolving disputes →
Authority, accountability and resilience →
Tests, stop conditions and unresolved work →
Read the exploration goalDefine the level and kind of understanding required of people affected by public decisions, including whether knowing the system's purpose suffices or they must be able to scrutinize its decision factors.
What we can say so far
On Danaher’s normative account, people affected by public decisions need more than a general explanation of an algorithm’s purpose: they should be able to understand and examine the reasons or factors shaping a decision. Specialist-only interpretability is not enough for political purposes, and a human decision-maker’s mere presence does not ensure meaningful understanding. This does not require every person to master every technical detail. The supplied material does not establish a precise level of explanation, what information or access would make scrutiny effective, or a test for deciding when the requirement is met.
What remains open
- No precise threshold for adequate understanding or scrutiny is specified.
- The material does not identify what information, access, or explanation would enable affected people to examine decision factors effectively.
- No operational test is supplied for determining whether a particular public decision system meets the requirement.
Conditions and limits
- This is an attributed account of Danaher’s argument in an accessible author manuscript, as interpreted in the supplied evidence; it is not an independently established or universally accepted standard.
- The claim that purpose alone is insufficient is a normative argument grounded in moral equality and legitimate participation, not an empirical finding.
- The material does not require understanding every technical detail; it distinguishes public political understanding from specialist interpretability.
Objections to consider
- The distinction between interpretable and non-interpretable systems does not establish what level of explanation is adequate for affected people to scrutinize decision factors.
- The process-focused account supports understanding as important but does not say how much understanding is enough.
Evidence and related ideas
Supporting evidence, qualifications and context play different roles in this answer.
supports
People need to examine the factors The author says a broad account of an algorithm’s purpose is not enough when it is used to exercise authority over citizens. He argues that, out of respect for citizens’ moral equality, people must be able to examine and question the factors the system uses, though they need not understand every technical detail.
Directly supports the distinction between a broad purpose explanation and the ability to examine and question the factors used, while also limiting the claim by saying exhaustive technical understanding is unnecessary.