Contribution to the handbook
Priority · Assessed 2026-10-27
The control categories make materially different operating arrangements visible, while the accompanying evidence warns that nominal human involvement or override may not enable meaningful review. This is relevant to specifying safeguards and testing whether control is effective.
Does this challenge the goal?
In-scope gap
The question distinguishes human-command, human-monitoring, and no-human-control arrangements, which are relevant to specifying and testing governance safeguards. It does not challenge the goal or require changing the definition.
The source’s categories describe formal control; they do not establish that a reviewer can understand, challenge, or effectively stop a system.
Why this category?
- Material distinction among system-control arrangements
- Consequential limit: formal human presence may not provide understanding or effective challenge
- Relevant to safeguard design and testing
These are conceptual distinctions and a source-based concern, not evidence that any particular arrangement provides effective oversight.
This is an AI assessment of contribution to the goal, separate from whether the question has an answer.
Making and interpreting laws →
Judging situations and resolving disputes →
Authority, accountability and resilience →
Tests, stop conditions and unresolved work →
Read the exploration goalIdentify and distinguish the author's levels of human control by the need for a human command and the availability of human monitoring or override.
What we can say so far
The author distinguishes three levels of human control: (1) the relevant action requires a human command; (2) the system can act on its own, but a person can monitor and override it; and (3) it acts without human monitoring or override. The distinction turns on whether a human command is required and, if not, whether monitoring or override remains available.
What remains open
- The supplied evidence does not establish how effective human monitoring or override would be in practice; that limitation does not prevent identifying the three levels.
Conditions and limits
- These categories describe formal control arrangements; their existence does not establish that a person can understand, effectively challenge, or stop the system.
- The evidence is an interpretation of the author’s manuscript text, not independent new evidence.
Objections to consider
- The example cautions against treating formal review as proof of effective control. The answer limits the taxonomy to formal control arrangements and states that practical effectiveness is not established.
- The answer distinguishes availability of monitoring or override from a person's ability to understand and challenge the system; actual effectiveness remains a stated limitation.
- The answer explicitly treats human presence as distinct from effective control and does not claim that formal involvement ensures understanding.
Evidence and related ideas
Supporting evidence, qualifications and context play different roles in this answer.
context
People may remain involved An algocratic system may be fully automated, partly automated, or retain human supervision and input.
Establishes that algocratic systems can retain varying degrees of human involvement, but does not itself distinguish the three control levels.
The Threat of Algocracy: Reality, Resistance and Accommodation
Read full source: The Threat of Algocracy: Reality, Resistance and Accommodation (opens in a new tab) ↗Read source discussion: The Threat of Algocracy: Reality, Resistance and Accommodation →