Contribution to the handbook
Priority · Assessed 2026-10-27
Possible convenience, promised benefits, and opaque steering could weaken scrutiny even where people formally retain a choice. This is a consequential risk for citizen authority and safeguards, balanced by the source’s warning that rejecting algorithmic systems may also be difficult or undesirable.
Does this challenge the goal?
In-scope gap
The question examines possible deference and reduced scrutiny, a risk relevant to citizen accountability within the existing goal; it does not reject that goal.
The cited account attributes a possible acceptance mechanism to Morozov as discussed by the author; it does not establish how often people accept systems for these reasons.
Why this category?
- consequential citizen-accountability risk
- mechanism of deference
- tradeoff and alternative
- safeguard relevance
The warning is a proposed mechanism, not measured evidence of public behavior or actual harm. The packet also notes possible benefits and practical limits to resistance, without settling how those considerations should be weighed.
This is an AI assessment of contribution to the goal, separate from whether the question has an answer.
- How might people accept algorithmic control without understanding its reasoning?
- Convenience may hide how control works
- People need to examine the factors
- Resistance has costs
- Expert control raises its own concern
- Resistance may be hard to carry out
- Specialist explanations may not be enough
- Complex systems are hard to understand
- Possible in principle, difficult in practice
Authority, accountability and resilience →
Tests, stop conditions and unresolved work →
Read the exploration goalExplain possible reasons people would accept a system that steers their actions despite not knowing how it arrives at its directions.
What we can say so far
People might accept algorithmic steering because they expect personal or social benefits, or because the system offers practical or procedural advantages. In the account attributed to Morozov and discussed by the author, people may provide data in return for promised benefits while receiving little explanation of how the system produces them. These are possible incentives, not evidence that users actually accept systems for these reasons or that the promised benefits materialize.
What remains open
- The supplied evidence does not establish whether people actually accept algorithmic systems for these reasons, or how common such acceptance is.
Conditions and limits
- The benefit-based account is attributed to Morozov as relayed by the author; it is not presented as an empirical finding by Danaher.
- The benefits are promised or perceived and are not shown to occur.
- The answer concerns possible reasons for acceptance, not a claim that acceptance is universal or inevitable.
Evidence and related ideas
Supporting evidence, qualifications and context play different roles in this answer.
supports
Convenience may hide how control works The paper uses Morozov’s warning to describe systems that can steer people toward or away from actions without explaining why. People may accept that control in return for promised personal or social benefits, while supplying the system with their data and receiving little clarity about how it produces those benefits.
Directly supplies the possible exchange of data and acceptance of limited transparency for promised personal or social benefits.
The Threat of Algocracy: Reality, Resistance and Accommodation
Read full source: The Threat of Algocracy: Reality, Resistance and Accommodation (opens in a new tab) ↗Read source discussion: The Threat of Algocracy: Reality, Resistance and Accommodation →
context
Understanding may be the deeper problem Danaher says difficulty understanding how an algorithm shapes a decision may be as serious as, or more serious than, the fact that its role is hidden. He uses opacity to mean that people may find a process hard to understand through human reasoning.