The Threat of Algocracy: Reality, Resistance and Accommodation

What the idea means

The article places algorithm use in public decisions within a wider increase in algorithm use and data collection.

Why it matters

This growth motivates the author’s question, but the passages do not measure its scale or show how common it is in public bodies.

Question this helps explore

What developments motivate the article?

Evidence and limits

The author presents a trend and a forecast, not a measured account of how widely public bodies use algorithms.

Addresses: The growth of algorithm use

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 1, 2

What the idea means

An algorithm follows steps to derive an output from inputs, such as data. The article focuses on algorithms run by computers.

Why it matters

This scope connects the discussion to increasing use of data; it does not cover every possible algorithm.

Question this helps explore

What does the article mean by an algorithm, and why does it narrow its focus?

Evidence and limits

The author defines algorithms as step-by-step instructions and explains why he limits his discussion to computer-programmed versions.

Addresses: The article’s definition and scope

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 1, 4

What the idea means

The question is not only whether an algorithm produces a useful result. It is also whether the process used to make a public decision can be morally and politically justified.

Why it matters

The process matters because public decisions issue rules and judgments that people must follow. The article’s stated focus does not assess every risk from government algorithms.

Question this helps explore

What problem does the author examine in public decisions?

Evidence and limits

The author treats the standing of processes that issue coercive rules and judgments as important, while explicitly setting aside privacy and data-protection concerns.

Addresses: The moral and political standing of decision processes

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 1, 2

What the idea means

Algorithm-based systems may shape what people can do in public decisions and what they can understand about those decisions.

Why it matters

The concern is whether people retain meaningful opportunities to take part in decisions that affect them. These passages do not show how often the risk occurs.

Question this helps explore

What is the threat of algocracy?

Evidence and limits

This is the author’s claim about a possible risk, not an independently established finding about all algorithm-based systems.

Addresses: The article’s central concern

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 1, 2

What the idea means

The term refers to how a governance system is organized around computer algorithms, not to machines taking power for themselves.

Why it matters

This keeps the article focused on how decision systems work rather than on a future takeover scenario. The author does not rule out that such a scenario could be possible in the future.

Question this helps explore

What does Danaher mean by algocracy, and what does he exclude?

Evidence and limits

The author distinguishes his present focus from a possible future scenario in which intelligent AI controls the world.

Addresses: The scope of the term

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 3, 4

What the idea means

Algorithms may arrange information used in decisions and help process or communicate it. In doing so, they can shape people’s interactions with one another, with data and with affected communities.

Why it matters

The concern covers how a decision system is organized around people, not only whether an algorithm makes the final decision.

Question this helps explore

How does an algocratic system shape governance?

Evidence and limits

The definition covers how decision data is organized and moved through a system, and how that can shape human interactions.

Addresses: The author’s definition of algocracy

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 4

What the idea means

An algorithm may shape which information people see and how it is arranged. It may also help change the surroundings that affect what people can do.

Why it matters

The author’s account includes both information flows and the physical conditions in which people act.

Question this helps explore

By what means can algorithms constrain human activity?

Evidence and limits

The author presents these as possible ways systems work, not as measured findings about particular public decisions.

Addresses: Ways an algorithm-based system can shape activity

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 4

What the idea means

The author plans to explain the threat, assess resistance and accommodation, and conclude that governance may keep practical benefits and virtues in how decisions are made while losing human control and understanding.

Why it matters

This shows the direction of the article’s argument; the supplied passages do not establish the detailed reasons for its assessments or specify these virtues.

Question this helps explore

How does the article organize its argument and conclusion?

Evidence and limits

The supplied passages give this roadmap and conclusion, but not the full arguments developed in the later sections.

Addresses: The article’s roadmap and stated trade-off

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 2, 3

What the idea means

Markets shape action through prices, bureaucracies through laws and rules, and algocracies through algorithms. The general definition does not depend on a particular technology; the author focuses especially on data-mining algorithms.

Why it matters

This distinction avoids treating data mining as a requirement of every algocracy. It also makes clear that algorithm-based systems can be part of existing legal or bureaucratic arrangements rather than replacing them.

Question this helps explore

How does the author define algocracy and distinguish it from other systems?

Evidence and limits

The passage distinguishes systems by what structures people’s actions, says their boundaries can overlap, and leaves the general definition open to different technologies before narrowing the discussion to data mining.

Addresses: The meaning and scope of algocracy

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 5

What the idea means

The author associates modern data mining with very large collections of data gathered through monitoring technologies.

Why it matters

The scale and sources of the data are relevant to concerns about how information is collected and used.

Question this helps explore

What data infrastructure does the author associate with modern data mining?

Evidence and limits

The passage describes large datasets and monitoring networks as a distinctive feature of these systems.

Addresses: The data used by the systems under discussion

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 6

What the idea means

In a subject-based search, people decide what patterns the algorithm should seek. In a pattern-based search, the algorithm finds patterns without people first specifying them. People may also review or simply carry out the resulting recommendations.

Why it matters

A person’s involvement can occur at different stages, so it matters whether people set the search, check the result, or only act on it.

Question this helps explore

What roles can people and algorithms have in data mining?

Evidence and limits

The passage distinguishes searches set by people from searches in which algorithms find patterns, and also describes different human roles in handling recommendations.

Addresses: Human roles and search modes in algorithm-based decisions

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 6

What the idea means

In the first category, a person must command the system to carry out the relevant action. In the second, the system can act on its own while a person can monitor and override it. In the third, it acts without human monitoring or override.

Why it matters

The categories help distinguish a required human command from later checking or from no human intervention. They do not by themselves show whether a person can understand or effectively challenge the system.

Question this helps explore

What levels of human control does the author distinguish?

Evidence and limits

The passage adapts three categories from discussion of robotic weapons to other systems, distinguishing them by whether a human command is required and whether monitoring or override is possible.

Addresses: The categories of human control

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 7

What the idea means

The first example requires a human agent to request or demand that the algorithm select audit targets. The second system works autonomously and produces possible actions that human agents may choose whether to follow. The final category leaves everything to machines.

Why it matters

The example distinguishes a required human command from a person’s later choice about an automated recommendation.

Question this helps explore

How does the author illustrate different levels of human control in tax enforcement?

Evidence and limits

The passage maps the categories onto a tax-enforcement example and specifies what a human command, human review, and full automation could mean.

Addresses: The practical meaning of the human-control categories

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 7

What the idea means

An interpretable system has reasons that people can understand and describe. A non-interpretable system does not offer an explanation that people can reduce to human language.

Why it matters

If people cannot understand a system’s reasons, they may struggle to check its judgment even when they are formally involved.

Question this helps explore

Can people understand why a data-mining system reaches a result?

Evidence and limits

The passage distinguishes systems that can be expressed in human language from systems whose complexity prevents that kind of explanation.

Addresses: Whether algorithmic decisions can be explained

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 7

What the idea means

The author says that making systems learn patterns and predictions from data raises a known challenge: people may not be able to understand how the system reached its result.

Why it matters

This matters when public decisions rely on such systems and people are expected to check them.

Question this helps explore

What issue does the author connect to machine learning?

Evidence and limits

The passage links the growth of machine-learning tools for finding patterns and making predictions with the problem of interpretability.

Addresses: The challenge of explaining learned patterns and predictions

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 8

What the idea means

Hiddenness is about data practices that may occur without people’s knowledge or consent. Opacity is about decision reasoning that is inaccessible to human understanding.

Why it matters

The distinction helps avoid treating privacy concerns and concerns about understanding decisions as the same problem.

Question this helps explore

What two concerns does the author identify?

Evidence and limits

The passage names hiddenness and opacity as distinct concerns and describes their different subjects.

Addresses: The moral and political concerns in the discussion

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 8

What the idea means

Hiddenness concerns how personal data is collected and used. Opacity concerns whether people can participate in political procedures when decisions rely on systems whose reasoning may be inaccessible.

Why it matters

Addressing privacy alone would not settle the separate question of whether people can take part in political decision-making. The passage identifies political authority and legitimacy as the basis for the opacity concern.

Question this helps explore

How does the author distinguish the reasons to worry about hiddenness and opacity?

Evidence and limits

The passage expressly separates hiddenness, grounded in privacy and control over personal information, from opacity, grounded in political participation and the authority of public procedures.

Addresses: The different values behind the two concerns

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 8

What the idea means

A decision-making process is legitimate, in the author’s account, when it has the quality needed to exercise authority over people’s lives rightfully.

Why it matters

This definition explains why the author connects opacity to political authority: the concern is whether people’s participation in public procedures is undermined.

Question this helps explore

What does legitimacy mean for public decision-making?

Evidence and limits

The passage defines legitimacy in terms of whether coercive public processes may rightfully exercise authority over people.

Addresses: The author’s definition of legitimacy

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 8

What the idea means

Both discussions concern code that shapes people’s actions, but they ask different questions: who controls the code, and whether its use hides how public decisions are made.

Why it matters

This distinction clarifies that Danaher’s focus is transparency in public decision-making, rather than ownership and control of the regulatory code.

Question this helps explore

How does Danaher distinguish his concern about code from Lessig’s?

Evidence and limits

The passage states that Lessig focuses primarily on ownership and control, while Danaher focuses on how code can make public decision-making less transparent.

Addresses: The contrast between two concerns about code as regulation

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 6

What the idea means

The author introduces different ways to judge whether a public decision process may rightfully exercise authority. Pure instrumentalism is the view that consequences alone determine legitimacy.

Why it matters

This preserves what the supplied text actually explains without guessing what the other two schools believe.

Question this helps explore

Which views about legitimate public decision-making does the supplied passage describe?

Evidence and limits

The passage identifies three broad schools but describes only pure instrumentalism before the available text ends.

Addresses: The beginning of the author’s account of legitimacy

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 8

What the idea means

The discussion focuses on hiddenness and opacity rather than claiming these are the only concerns raised by algorithmic systems.

Why it matters

This caveat keeps the account from being read as a complete list of moral and political issues for every system.

Question this helps explore

What is the scope of the concerns discussed in this section?

Evidence and limits

The author says the two concerns apply for the purposes of this discussion and explicitly notes that other systems can raise other concerns.

Addresses: The limits of the discussion’s scope

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 8

What the idea means

The author cites a facial-recognition system used to revoke driving licences in Massachusetts as an example of bureaucracy being automated.

Why it matters

The example shows that automation can occur within an existing bureaucratic system. The passage does not explain how the system worked or assess its effects.

Question this helps explore

What example of automated bureaucracy does the author mention?

Evidence and limits

The footnote cites the Massachusetts licensing system as an illustration of an automated bureaucratic system.

Addresses: An illustration of automated bureaucratic systems

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 6

What the idea means

Hiddenness concerns privacy and control over personal information. Opacity concerns people’s ability to take part in political procedures involving algorithm-based systems.

Why it matters

Treating opacity only as a privacy issue could miss the question of whether people can participate in public decision-making.

Question this helps explore

How does the author distinguish hiddenness from opacity?

Evidence and limits

The passage connects hiddenness to privacy and control over personal information, and opacity to participation in political procedures and the authority of public decisions.

Addresses: The different grounds for the hiddenness and opacity concerns.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 9

What the idea means

For the author, opacity is about people’s participation in political procedures, not privacy or control over personal information. Some theorists had still used privacy terms when discussing it.

Why it matters

Keeping these points separate helps readers see the difference between the author’s account of opacity and the way some earlier discussions framed it.

Question this helps explore

What does the author say opacity is about, and how had some theorists framed it?

Evidence and limits

The passage explicitly separates opacity’s political concern from privacy and personal-information control, while noting that some theorists nevertheless framed their discussion in those terms.

Addresses: The author’s distinction between opacity and privacy, and his observation about how some theorists discussed opacity.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 9

What the idea means

One approach asks whether a process produces good results. Another asks whether the process has valuable features regardless of its results. A third considers both.

Why it matters

Debates about decision systems can differ because people may be using different standards to judge them.

Question this helps explore

What standards can be used to judge a public decision process?

Evidence and limits

The passage distinguishes result-focused, process-focused, and combined approaches.

Addresses: The three broad approaches to legitimacy.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 9, 10

What the idea means

On this view, the value of a decision process depends on what it achieves.

Why it matters

A process that produces good results may still raise concerns if people also care about how it treats those involved.

Question this helps explore

What makes a process acceptable under a result-focused view?

Evidence and limits

The passage describes this view as judging procedures by how well they achieve their aims.

Addresses: Pure instrumentalism.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 10

What the idea means

A process-focused view values features such as understanding and participation even when its results are not yet known or judged.

Why it matters

This view offers standards for judging a decision process beyond whether it achieves a desired result.

Question this helps explore

Why does a process-focused view emphasize features beyond the results?

Evidence and limits

The passage says it is difficult to know the ideal outcome in advance, so process-focused views emphasize virtues that do not depend on the outcome.

Addresses: Pure proceduralism and its reason for emphasizing process features.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 10

What the idea means

The author thinks a decision process should be judged by what it achieves and by how it treats and involves people.

Why it matters

Good results alone would not settle whether a process is acceptable, and respectful participation alone would not settle whether its results are acceptable.

Question this helps explore

Why does the author favor judging both process and results?

Evidence and limits

The passage gives examples of how either standard alone could permit a troubling decision: outcome-focused judgment could excuse cruel witness treatment, and process-focused judgment could excuse clearly bad consequences when people were treated respectfully and allowed meaningful participation.

Addresses: The author's preference for a mixed approach.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 10

What the idea means

Estlund’s example concerns giving decision power to a sub-group because its members are thought to have generally better abilities to know what outcomes are right. The author uses this as a starting point for a different argument about algorithm-based systems.

Why it matters

The analogy helps show how claims about better results can raise questions about who gets decision power. It does not establish that any group or system actually has superior knowledge.

Question this helps explore

How does Estlund’s definition of epistocracy help frame the concern about algorithm-based systems?

Evidence and limits

The passage introduces Estlund’s argument as a model for developing a related but distinct argument, and defines epistocracy by reference to a sub-group with generally superior epistemic capabilities.

Addresses: The analogy between epistocracy and algocracy.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 11, 12

What the idea means

The conclusion follows only if the value premise and factual premises hold. The group in the argument is a sub-group thought to have generally better abilities to know which outcomes confer legitimacy.

Why it matters

The conclusion does not itself recommend concentrated authority. The passage says the factual premises can be challenged and does not defend them here.

Question this helps explore

What does the argument conclude, and what kind of group does its epistocracy premise describe?

Evidence and limits

The passage lists the argument’s premises and conclusion, and describes epistocracy as favoring a sub-group of a society with generally superior epistemic capabilities.

Addresses: The structure and conclusion of the argument about rule by knowledgeable people.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 12

What the idea means

A public decision process needs legitimacy for its authority over people’s lives to be rightful.

Why it matters

The debate is not only about whether a process reaches good results; it is also about whether it has the right to make binding decisions.

Question this helps explore

What does legitimacy mean in this discussion?

Evidence and limits

The author defines legitimacy in terms of whether coercive public decision-making processes may rightfully exercise authority over people.

Addresses: The author’s definition of legitimacy.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 9

What the idea means

The author places his concern about judging only by results or only by process alongside a familiar debate in ethics about consequences and duties or constraints.

Why it matters

This frames the difficulty as part of a wider ethical disagreement; the passage does not explain or resolve that debate.

Question this helps explore

What ethical debate does the author connect to the problems with relying only on results or only on process?

Evidence and limits

The footnote explicitly says that the oddness of those conclusions reflects arguments in the consequentialist/deontologist debate in ethics.

Addresses: The ethical framing of the author’s examples about pure result-focused and process-focused views.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 11

What the idea means

The argument is not limited to rule by a permanent, expert human class. It also applies when people defer to an algorithm-based system because they think it has superior access to the right answers.

Why it matters

This framing directs attention to why a system is given authority, not just whether its decision-makers are human or machine-based.

Question this helps explore

What does the paper mean by algocracy, and how does it relate to epistocracy?

Evidence and limits

The key link is epistemic favouring: decision-makers or systems receive authority because they are thought to know better. The paper says this advantage may be limited to certain decisions or arise from a group’s circumstances, rather than from generally superior individuals.

Addresses: The paper’s definitions and framing

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 13

What the idea means

A decision’s result is not the only concern. The people affected should be able to grasp the reasons and workings of the process that produced it.

Why it matters

If the process is too opaque for people to assess, it may fail an important condition for accepting public decisions.

Question this helps explore

What makes a public decision-making process acceptable to those affected?

Evidence and limits

The paper presents these conditions as background to its argument about algocracy, rather than as a result of its own empirical study.

Addresses: The legitimacy conditions discussed in the paper

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 14

What the idea means

Some accounts of acceptable public decision-making call for affected people to participate and discuss decisions, rather than only receive the results.

Why it matters

This raises a concern for systems that limit how people can interact with the process, though the passage does not specify which forms of participation are necessary.

Question this helps explore

What role can public participation and discussion play in a decision-making process?

Evidence and limits

The passage presents participation and deliberation as requirements defended by other theorists; it does not claim that participation alone makes a process acceptable.

Addresses: The theories of political legitimacy cited in the paper

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 14

What the idea means

A group’s knowledge advantage does not guarantee that its reasons can be shared or that people will continue to understand why it has authority.

Why it matters

A process can become opaque even when its decision-makers were initially favoured for a real or believed advantage.

Question this helps explore

Why might a group’s decision-making remain hard to explain, even when it is thought to know better?

Evidence and limits

These are different limits on explaining or preserving the reasons for deference. The passage presents them as possible problems, not as inevitable outcomes.

Addresses: Possible sources of opacity in epistocratic systems

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 15

What the idea means

A system may gain support because it appears to perform well compared with a human alternative. As people defer to it, its workings may become harder for them to follow.

Why it matters

A system’s apparent usefulness does not by itself show that people can understand or assess the decisions it makes.

Question this helps explore

How could an initially attractive algorithm-based system become a threat?

Evidence and limits

The author presents a possible gradual path from instrumental appeal to growing opacity, not a finding that every such system follows it.

Addresses: The paper’s account of the threat of algocracy

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 15

What the idea means

A system may influence people’s actions without giving them a clear reason for its guidance. The paper describes the appeal of promised gains such as better health, cleaner air, or safety as a reason people might accept this arrangement.

Why it matters

People may experience a system as helpful while lacking a clear account of how it affects their choices or outcomes.

Question this helps explore

How might people accept algorithmic control without understanding its reasoning?

Evidence and limits

This is a view the author quotes and discusses, not an empirical finding by Danaher in these passages.

Addresses: Morozov’s argument as presented in the paper

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 15, 16

What the idea means

Workers may understand that the system organizes storage, yet still need algorithmic help to locate goods and navigate the space. The paper’s illustration contrasts this with familiar, human-readable ways of grouping items.

Why it matters

The example makes the paper’s concern concrete: a system can organize people’s work in ways they cannot themselves track.

Question this helps explore

How can an algorithm shape a person’s work even when its purpose is understandable?

Evidence and limits

The example shows a difference between understanding the broad goal and being able to follow the system’s detailed workings. The supplied passages do not establish that all warehouses use this approach.

Addresses: The warehouse illustration of algocratic organization

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 16, 17

What the idea means

The system uses available shelf space to decide where each item goes, instead of relying on a layout that workers can easily remember. The author describes less wasted product and faster stock turnover as apparent benefits.

Why it matters

The example shows how a system can have an understandable goal while using a way of working that people cannot readily follow in detail.

Question this helps explore

How does the warehouse storage system work, and what benefits does the author attribute to it?

Evidence and limits

This is an illustration of a reported system, not a result from a study conducted by the author.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 17

What the idea means

Workers understand why the warehouse is organized for efficiency, but cannot track every barcode and shelf location. They rely on the algorithm’s greater capacity to manage those details.

Why it matters

The author uses this example to show how people can remain involved in a task while becoming dependent on a system they cannot fully follow.

Question this helps explore

Why do warehouse workers depend on the algorithm, even if they understand its broad purpose?

Evidence and limits

The author uses the warehouse as an illustration of how people may depend on a system when its detailed workings are beyond any one person’s ability to follow.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 17, 18

What the idea means

The author describes a possible progression: people may first rely on relatively understandable systems, then on systems that become too complex to follow. He says public systems may also combine large data streams with other algorithms.

Why it matters

The concern is that people could have less opportunity to take part in and understand decisions made with public authority. The passage presents this as a risk, not as a demonstrated outcome.

Question this helps explore

Why does the author think growing reliance on algorithms could make public decisions harder to take part in or understand?

Evidence and limits

This is the author's warning about a possible extension of the warehouse example, not evidence that public systems have already reached this state.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 18

What the idea means

The author treats participation and understanding as necessary features of decision procedures. If reliance on algorithms weakens both, he argues, the procedures’ legitimacy is at risk.

Why it matters

This standard asks not only whether a system reaches useful results, but also whether people can take part in and understand how decisions are made.

Question this helps explore

What conditions does the author say decision-making procedures must meet to be legitimate?

Evidence and limits

This summarizes the author's stated argument about legitimacy without defining it as whether people subjectively accept a process.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 18

What the idea means

Knowing only that a system aims to identify likely tax evaders would not, in the author’s view, let citizens critically examine how it acts. He grounds this requirement in respect for citizens as moral equals. The standard is more than a general rationale but less than complete technical mastery.

Why it matters

People need a way to question the basis of decisions made with public authority, without having to become experts in every part of the system.

Question this helps explore

How much must people understand about an algorithm used in public decisions?

Evidence and limits

The author uses a tax-evasion monitoring system as a hypothetical example and argues that people need more than a general description of its goal.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 19

What the idea means

Rules may keep system details from the public for commercial reasons or to reduce attempts to evade or attack a system. The author says those rules could be revised, but powerful interests may resist.

Why it matters

Even a system that could be explained may remain hard to examine if people cannot access information about it.

Question this helps explore

Why might people be unable to inspect how an algorithmic system works?

Evidence and limits

The author presents commercial and government secrecy as obstacles, while noting that laws could be changed.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 20

What the idea means

Instead of having people specify every rule before use, these systems can be trained on large collections of data to produce rules or patterns of their own. The paper names recommendation systems and IBM's Watson as examples.

Why it matters

This matters to the argument because people may find it harder to understand a system when its rules were not fully laid out in advance.

Question this helps explore

How does the paper describe the role of machine learning in data analysis?

Evidence and limits

The author is describing a general feature of machine-learning systems, not reporting a new experiment.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 20

What the idea means

The people who build or use a system may not be able to say exactly why it produced a particular result. The paper notes both efforts to improve explanations and possible costs of doing so.

Why it matters

If people cannot get a useful account of a result, it may be harder for them to examine or question decisions based on it.

Question this helps explore

Why might machine-learning results be difficult to explain?

Evidence and limits

This is a limitation the paper reports from machine-learning research, not a finding of the author's own experiment.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 20

What the idea means

The author says new algorithms may rely on other algorithms and be made by teams, rather than standing alone. The text provided ends before completing the sentence about how this work is done.

Why it matters

This is introduced as another factor in making systems more open to understanding, but the cut-off passage does not give the full explanation.

Question this helps explore

What additional difficulty does the author begin to raise about understanding algorithmic systems?

Evidence and limits

The passage introduces linked systems and team authorship as another factor, but the supplied text cuts off before the full explanation.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 20

What the idea means

The author says human workers may only be involved for the time being and predicts that robots could take over such warehouse work. He notes Amazon's use of Kiva robots.

Why it matters

This limits how broadly the example can be applied to human participation: the author does not assume that workers will always remain in the process.

Question this helps explore

Does the author expect human workers to remain part of these warehouse systems?

Evidence and limits

This is the author's forecast and accompanying note in footnote 20, not a claim that robots have already replaced the workers described.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 17

What the idea means

A person may need to understand how many connected parts work together, rather than inspect one algorithm. The author says doing so could take substantial time and effort.

Why it matters

People may have trouble understanding decisions made through such systems or taking part in choices about them.

Question this helps explore

Why might people struggle to understand an algorithmic system?

Evidence and limits

The passage says useful results may come from interactions among many systems, not from one algorithm alone. It therefore argues that people’s ability to understand or take part in the system may be limited, and that opacity is likely.

Addresses: The difficulty of understanding complex algorithmic systems

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 21

What the idea means

Human authorities may choose aims such as efficiency or crime reduction, while programmers build systems to pursue them. Yet the resulting system may become too complex for its designers or sponsors to fully grasp.

Why it matters

Knowing which people set a system’s goals may not be enough to make its operation understandable or accountable.

Question this helps explore

Does knowing who built a system resolve concerns about who controls it?

Evidence and limits

The author describes managers or public officials setting goals that programmers implement. The passage also says complex systems may exceed even these groups’ ability to understand them.

Addresses: The role and understanding of human elites behind algorithmic systems

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 21

What the idea means

The author distinguishes rule by an algorithm from rule by the people who set its goals and operate it. Concentrating authority among those experts may remain a problem even if they are identifiable.

Why it matters

The political question is not only whether a machine can be understood, but also who gets to make decisions for the public.

Question this helps explore

Would human control behind an algorithmic system remove the political concern?

Evidence and limits

The author argues that even if elites control the systems, handing political authority to them is procedurally problematic. The passage describes this as shifting the concern toward rule by experts.

Addresses: Political authority held by experts behind systems

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 21, 22

What the idea means

An algorithm might be understandable to people with relevant technical training while remaining hard for the wider public to assess.

Why it matters

A system’s explanation may need to serve more than its technical peers if the system affects public decisions.

Question this helps explore

Who needs to be able to understand an algorithm for it to be politically acceptable?

Evidence and limits

A note in the passage says that interpretability is often understood as something available to suitably trained peers, and that this would not be enough for political purposes.

Addresses: The limits of specialist-focused interpretability

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 22

What the idea means

The author questions whether blocking or dismantling these systems could be done across the many places where public decisions are made.

Why it matters

A resistance strategy may be difficult to apply widely, even for people who share its aims.

Question this helps explore

Could resistance to algorithmic systems be carried out across public decision-making?

Evidence and limits

The passage reports Morozov’s call to politicise the issue and sabotage systems, then questions whether that form of resistance is achievable across the full range of public decisions.

Addresses: The practical reach of resistance

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 22

What the idea means

The author does not treat resistance as the obvious moral answer. Benefits from better results or from decision procedures may count in favour of using systems, while their risks count against them.

Why it matters

The choice may call for weighing the reasons to resist against the reasons to accommodate some systems.

Question this helps explore

Is resisting algorithmic systems always morally preferable to using them?

Evidence and limits

The passage says there are moral arguments for using such systems based on outcomes and on the way decisions are made. It therefore frames resistance as involving competing values.

Addresses: The moral case for and against resistance

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 22, 23

What the idea means

People may use technologies that collect data without being fully aware of how that data is used or what effects it can have.

Why it matters

A system that is both familiar and difficult to see may be harder to challenge or dismantle.

Question this helps explore

Why might people find it difficult to resist the systems that collect data about them?

Evidence and limits

The passage argues that monitoring and data-mining technologies are both widespread and often hidden in plain sight. It says daily reliance can make people less aware of their possible role in algorithmic systems.

Addresses: The everyday presence and low visibility of monitoring

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 23

What the idea means

The author cautions against treating one problem, such as opacity, as the whole moral assessment. Other risks and possible gains also matter.

Why it matters

Whether to use a system may depend on the particular risks and benefits involved.

Question this helps explore

How should concerns about algorithmic systems be weighed against their benefits?

Evidence and limits

The passage argues that opacity is one concern among several and says it should be considered alongside privacy effects and possible benefits.

Addresses: Balancing risks and benefits

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 23

What the idea means

Algorithms may help people and public institutions draw useful patterns or actions from data that would otherwise be difficult to use.

Why it matters

The possibility of practical value is one reason the author says the benefits of these systems should not be ignored.

Question this helps explore

What practical value might algorithmic systems bring to large data collections?

Evidence and limits

The passage says that increasingly large datasets may be put to good use through algorithmic technologies, for both social authorities and the public.

Addresses: The possible benefits of using large datasets

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 23

What the idea means

The author uses smart electricity grids as an example of a useful application of data monitoring and analysis.

Why it matters

This example supports the broader point that some systems may serve public goals, including responding to climate change and energy insecurity.

Question this helps explore

Can algorithmic systems support the use of renewable energy?

Evidence and limits

The passage says smart grids rely heavily on monitoring and data mining, and presents them as a way to improve the effectiveness and efficiency of renewable energy sources.

Addresses: The smart-grid example

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 23

What the idea means

The author presents operational efficiency and profitability as benefits of these warehouse systems, without treating those gains as an answer to concerns about the surrounding workplace.

Why it matters

A system’s practical gains and the conditions in which it is used may need separate consideration.

Question this helps explore

Can an algorithmic system produce operational benefits even when its wider setting is contested?

Evidence and limits

The passage credits the algorithms with reducing waste and inefficiency and increasing profit, while expressly separating that claim from judgments about the company and its broader work practices.

Addresses: The claimed benefits of Amazon’s warehouse algorithms

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 24

What the idea means

The author suggests that tracking tools may help people work toward personal aims by making it easier to set goals and observe their own behavior.

Why it matters

This is another possible benefit that may count in discussions about whether to accommodate algorithmic systems.

Question this helps explore

How might self-tracking apps help individuals?

Evidence and limits

The passage links these possible benefits to tools that help users set goals, try changes, and build habits.

Addresses: Possible individual benefits of self-tracking

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 24

What the idea means

The proposal is for algorithms to search financial information for patterns that may help agencies decide where to audit.

Why it matters

If useful, this could support tax collection and public services, but the passage describes a possible use rather than a demonstrated result for tax agencies.

Question this helps explore

How might algorithms help tax agencies address tax evasion?

Evidence and limits

The passage says agencies may lack resources and that individual staff may not see links across different pools of data. It proposes that algorithms could search those data and recommend audits.

Addresses: Algorithmic support for tax audits

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 24

What the idea means

This is a report of findings from research cited by the author, not a finding from the author’s own study. The claim is limited to certain prediction tasks.

Why it matters

It may support using algorithms in some decisions, but it does not show that they predict better everywhere or that they should control decisions.

Question this helps explore

What does the cited research say about algorithmic prediction compared with human experts?

Evidence and limits

The passage cites earlier work for the claim that algorithms outperform human experts on predictions in certain fields. It uses this as support for possible deference in some cases.

Addresses: The scope of reported prediction findings

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 24

What the idea means

The author signals a possible argument that algorithms can improve the way decisions are made, not only what results they produce.

Why it matters

This could matter when comparing systems, but the supplied passage does not give enough detail to assess the proposed procedural benefits.

Question this helps explore

Could algorithmic systems improve how decisions are made, not just their results?

Evidence and limits

The passage distinguishes benefits in outcomes from benefits in decision procedures and refers to Zarsky’s case for the latter. The text provided ends before explaining that case.

Addresses: Possible procedural benefits

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 24

What the idea means

Profiling can be objectionable when it targets groups arbitrarily. The passage says targeting should instead rest on relevant grounds, such as a genuine likelihood of committing the relevant crime. Automated systems might avoid some human bias, but they are not guaranteed to do so.

Why it matters

Assessing a system’s fairness requires asking both whether it reduces bias and whether its grounds for targeting people are legitimate.

Question this helps explore

Could automated systems reduce bias while keeping profiling tied to legitimate grounds?

Evidence and limits

Passage 25 distinguishes arbitrary discriminatory targeting from targeting on legitimate grounds, then describes a possible advantage of automated systems. Passage 26 adds that automated systems can also reproduce bias.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 25, 26

What the idea means

Zarsky suggests that people who benefit from human bias may favor decision processes that leave room for it. Danaher reports this explanation but does not adopt it.

Why it matters

The argument raises the possibility that opposition to automated systems can reflect whose interests a decision process serves, but the passage does not establish that this explains opposition in general.

Question this helps explore

Why might some people prefer human-run profiling to automated profiling?

Evidence and limits

This is a position attributed to Zarsky, and the author explicitly distances himself from endorsing it.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 25

What the idea means

Building a system requires people to turn a task into steps and then code those steps. Decisions made during that process may reflect implicit or deliberate bias.

Why it matters

Checking the design process for bias matters even when a system reduces the role of human judgment at the point of decision.

Question this helps explore

How might bias enter an automated decision system?

Evidence and limits

The passage explains both a route by which bias can enter and a possible way to limit it.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 26

What the idea means

A decision system may improve outcomes or treat affected people more fairly in the process, while making it harder for them to understand or take part in decisions.

Why it matters

Judging such systems requires looking at more than whether they produce a desired result.

Question this helps explore

What benefits and costs should be compared?

Evidence and limits

The author frames the choice as a balance among possible results, procedural fairness, understanding, and participation.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 26

What the idea means

The author questions resistance as a complete answer because deciding whether the gains outweigh the losses may be difficult. He raises accommodation—keeping the systems while preserving participation by other means—as another approach.

Why it matters

The proposal shifts attention from whether to use such systems to how affected people can remain involved.

Question this helps explore

Does the author favor rejecting these systems or finding ways to keep people involved?

Evidence and limits

The author presents preserving participation alongside continued use as a possibility, rather than a settled solution.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 26

What the idea means

The approach keeps a person involved in decisions that would otherwise be made solely through automated data processing.

Why it matters

Review could give people a way to challenge or change decisions, although the passage does not establish that review is effective.

Question this helps explore

What does human review aim to provide?

Evidence and limits

The passage describes review and possible override as the core of this approach.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 27

What the idea means

The directive covered automated decisions with legal effects or significant effects on a person, including assessments such as work performance or creditworthiness. It allowed specified exceptions.

Why it matters

The example shows that human review had been proposed as a legal protection, but the passage does not establish how well the protection worked.

Question this helps explore

What human-review protection did the passage describe in European Union law?

Evidence and limits

The passage reports the rule and its exceptions as they appeared in the cited directive; it does not assess their later legal status or effects.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 27

What the idea means

Their proposal aims to protect people from unfair labels based on credit assessments by requiring some form of regulatory review and openness about system operation.

Why it matters

The passage reports their view that fears of people exploiting public information were not backed by credible evidence, but it does not independently assess that evidence.

Question this helps explore

What protections did Citron and Pasquale propose for automated credit assessments?

Evidence and limits

The proposals and the response to concerns about gaming are attributed to Citron and Pasquale, as reported by Danaher.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 28

What the idea means

The proposal would tell people when a system was used against them, let them review the material and method behind the decision, and give them an appeal to an impartial reviewer.

Why it matters

These steps aim to make automated decisions open to challenge, but the passage presents them as a proposal rather than a tested safeguard.

Question this helps explore

What rights did Crawford and Schultz propose for people affected by predictive systems?

Evidence and limits

The passage lists three parts of their proposed process and distinguishes its broad scope from the credit-assessment focus described just before it.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 28

What the idea means

A person may not be able to understand how a system reached a decision, either because its method is hard to interpret or because the decision depends on many linked systems.

Why it matters

A right to review may offer little practical help if people cannot access or make sense of the reasons behind a decision.

Question this helps explore

What technical limits might prevent people from reviewing automated decisions?

Evidence and limits

The author gives two reasons that technology may block review and raises, without resolving, the option of requiring methods people can interpret.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 28

What the idea means

Zarsky claims that reducing the role of human judgment could lessen the effect of bias against minorities and other less powerful groups.

Why it matters

This is a proposed procedural advantage of automated decisions, not proof that such systems protect these groups in practice. Danaher explicitly distances himself from the argument.

Question this helps explore

Could limiting human discretion make decisions fairer to groups with less power?

Evidence and limits

The passage reports Zarsky’s argument that computer-led decisions can protect weaker groups by limiting human discretion. It also states that Danaher does not endorse the argument.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 25

What the idea means

Making a system understandable could limit how it works or what it can deliver, while organizations that benefit from current systems may oppose such limits. The author also warns that introducing review rules after these systems have become dominant may be very difficult.

Why it matters

A review rule may be harder to use if it is adopted only after a system is already widely relied on.

Question this helps explore

What could make rules requiring understandable AI systems difficult to adopt?

Evidence and limits

The author says interpretability requirements could reduce the benefits sought from these systems and meet resistance from interested organizations.

Addresses: Whether human review can be required in practice

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 29

What the idea means

Citizens and judges may lack the knowledge to examine complex systems themselves. If they depend on specialists to interpret decisions, those specialists could gain substantial influence over public choices.

Why it matters

Making a decision open to review would not by itself ensure that ordinary people can meaningfully take part.

Question this helps explore

Could making AI decisions reviewable create a different concentration of decision-making power?

Evidence and limits

The author argues that most citizens and courts would need specialists to explain how complex systems work, and might not be able to challenge those explanations.

Addresses: The risk that reviewability creates a new expert elite

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 29, 30

What the idea means

People cannot understand every reason behind every decision that affects them, so they often rely on experts. The author sees this as a compromise, not as a reason to accept greater dependence; he says overcoming it would probably be better if that could be done.

Why it matters

The fact that expert advice is already common does not settle whether it is a good solution to AI decision-making.

Question this helps explore

Does existing reliance on experts show that expert control of AI review should be preserved?

Evidence and limits

The passage acknowledges that people already depend on experts, but says this practice is not necessarily worth preserving and that overcoming it would probably be preferable if possible.

Addresses: The argument that expert dependence already exists

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 30

What the idea means

Organizations that build or control data-mining systems may be better placed to gain from them than the people whose lives those systems affect. The author says this could deepen the existing imbalance between experts and ordinary citizens.

Why it matters

A review process may be less fair if one side has much greater access to data and the ability to use it.

Question this helps explore

How could data-mining systems change the balance between citizens and decision-makers?

Evidence and limits

The passage refers to arguments about a growing divide in the ability to use data-mining systems, especially between their controllers and affected citizens.

Addresses: The possible growth of unequal access to data's benefits

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 30

What the idea means

The proposed interventions could include medicines or devices that change thinking or feelings. The idea covers abilities used to learn facts as well as abilities used for practical or moral judgment.

Why it matters

The proposal is broader than helping people remember more; it also concerns how they reason and respond.

Question this helps explore

What does the proposed idea of human knowledge enhancement include?

Evidence and limits

The passage defines the term and gives examples such as drugs and neural devices that could affect thinking or emotion.

Addresses: The meaning and scope of epistemic enhancement

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 30, 31

What the idea means

The proposal aims to improve both what public decisions achieve and how people take part in making them. Better abilities might partly help people engage with increasingly complex decisions, but the passage does not show that enhancement would work. The author also says access would need to be available to everyone to help guard against control by a small group of experts.

Why it matters

The proposal concerns both the results and the process of public decision-making, not participation alone. It remains a proposed approach rather than a tested solution.

Question this helps explore

How is human enhancement meant to improve public decision-making?

Evidence and limits

The passage says the proposal aims to improve both the results of public decision-making and the decision process. It presents better information processing, memory, and emotional control as possible ways to support participation and partly address growing complexity.

Addresses: The proposed effects of human knowledge enhancement

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 30, 31

What the idea means

The example concerns people who review AI decisions and are allowed to overrule them. If Zarsky’s concern about their implicit bias is correct, enhancement might reduce that bias while also improving cognitive ability. This is a proposed possibility, not a demonstrated effect.

Why it matters

The example addresses a specific concern about human review; it does not establish that enhancement would remove bias or preserve all benefits of AI decisions.

Question this helps explore

Could enhancement help human reviewers avoid bias when they can override AI decisions?

Evidence and limits

The passage gives this as a possible example: if implicit bias is a serious problem when humans are kept in the loop and allowed to override algorithmic decisions, enhancement might be directed at reducing the bias while increasing cognitive ability.

Addresses: The conditional example about implicit bias in human review

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 31

What the idea means

The author points to systems that sort and match data in ways people cannot interpret, or that only make sense as part of a larger network of systems. The claim is that modestly improving human abilities would not bridge that gap without outside limits on the systems.

Why it matters

Making reviewers more capable may not be enough; the systems themselves may need to be constrained for review to be possible.

Question this helps explore

Why might improving human abilities still fail to make complex AI systems understandable?

Evidence and limits

The author says some systems may rely on methods and capacities far beyond what humans can understand, unless limits are placed on them.

Addresses: The gap between human ability and complex AI systems

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 32

What the idea means

If people reached very high levels of human ability, that might make it harder for a small group of humans to dominate. But the author argues that this would not make people able to understand systems whose workings go beyond human capacities.

Why it matters

Reducing unequal power among people and making AI systems understandable are different problems.

Question this helps explore

Would equalizing human abilities solve the threat posed by AI systems?

Evidence and limits

The continuation of the argument says enhancement might help prevent a human expert elite, while leaving the separate problem of systems beyond human ability.

Addresses: The difference between preventing rule by experts and preventing rule by AI

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 32, 33

What the idea means

Critics raise the concern that a social demand for enhancement could pressure people into using it or reduce their freedom to choose. The passage records that Danaher responds to this concern but does not say how he answers it.

Why it matters

The objection is part of the debate about the proposal, but this passage alone does not establish whether the response is convincing.

Question this helps explore

Does the proposal address concerns that social pressure to use enhancement could limit personal choice?

Evidence and limits

The passage says Danaher responds directly to these charges, but does not describe the substance of his response.

Addresses: The coercion and autonomy objection to enhancement

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 31

What the idea means

The author says that raising people’s abilities to human extremes is different from enabling them to follow processes beyond human understanding.

Why it matters

This matters because equalizing human abilities would not necessarily let people question decisions made through complex algorithms.

Question this helps explore

Would human enhancement alone make algorithmic decision-making understandable?

Evidence and limits

The passage distinguishes reducing differences among people from making complex algorithmic processes understandable.

Addresses: The claim that enhancement can answer concerns about algorithmic rule

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 33

What the idea means

The proposal combines people’s improved ability to understand decisions with a legal requirement that systems remain understandable to them.

Why it matters

If it worked, people might benefit from algorithms while retaining a way to examine their decisions. The passage does not show that this arrangement can be achieved.

Question this helps explore

Could human enhancement and legal limits together reduce the risk of rule by algorithms?

Evidence and limits

This is presented as a possibility, not as a demonstrated solution.

Addresses: The proposal to combine enhancement with human reviewability

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 33

What the idea means

The term describes ordinary people using recording or monitoring tools to observe those with authority, in contrast with authorities monitoring the public.

Why it matters

This approach shifts attention toward what citizens can record and reveal about powerful institutions.

Question this helps explore

What does sousveillance mean in the proposed response to algorithmic rule?

Evidence and limits

The passage defines the term and distinguishes it from surveillance by who is doing the watching.

Addresses: The section introducing sousveillance

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 34

What the idea means

The proposal is to turn monitoring tools toward powerful people and institutions, then use recorded information to challenge their actions.

Why it matters

If the recordings can be used effectively, people may have more ways to question authority. The passage does not show that this produces accountability in practice.

Question this helps explore

How do advocates think citizen recording could help hold powerful groups to account?

Evidence and limits

The passage describes the approach as a proposal and presents wider access to recording tools as a possibility.

Addresses: The sousveillance proposal for responding to surveillance by authorities

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 34

What the idea means

Mann’s proposal is that recordings can give people documentary support when they tell institutions what happened, while freedom-of-information laws can provide access to internal rules.

Why it matters

Together, these tools could help people contest decisions and make institutional processes more acceptable to the public. The passage reports the argument but does not establish that the tools achieve those results.

Question this helps explore

How might sousveillance help people challenge bureaucratic decisions?

Evidence and limits

This is Mann’s argument as reported in the passage, not a finding by the article’s author.

Addresses: Mann’s argument about recordings and access to institutional rules

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 35

What the idea means

The author argues that evidence-gathering tools do not enable ordinary people to understand decisions made through complex algorithmic systems.

Why it matters

A response that relies only on recording authorities may be inadequate when the reasoning process is not accessible to people.

Question this helps explore

Would sousveillance solve the problem when complex algorithms determine decisions?

Evidence and limits

The author says the possibility available in human-run processes does not carry over to decisions shaped by complex algorithmic systems.

Addresses: The author’s contrast between human-based decisions and algorithmic ecosystems

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 36

What the idea means

The author treats recording and understanding as separate tasks. Basic processing during recording does not amount to the wider sorting and analysis described in the next proposal.

Why it matters

People may need more than recording devices if they are to make sense of information about decisions.

Question this helps explore

What can sousveillance tools do on their own, and what must people still do?

Evidence and limits

The author distinguishes basic processing involved in recording from the more extensive processing that personal data-mining tools might provide.

Addresses: The passage’s description of sousveillance as data collection

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 36

What the idea means

The proposed partnership adds a person’s own data-mining and processing algorithms to their monitoring tools.

Why it matters

The idea aims to address the gap between collecting information and understanding it. The passage does not establish that personal AI helpers can do this reliably.

Question this helps explore

Could a personal AI partner help people understand algorithmic decisions?

Evidence and limits

The passage asks whether personal data-mining and processing algorithms could assist people, then introduces two possible forms of partnership.

Addresses: The proposed move from sousveillance tools to individual algorithmic partnerships

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 36

What the idea means

The non-integrative form keeps the algorithm separate from human biology; the integrative form combines the algorithmic system with the body.

Why it matters

The distinction matters because the proposals involve different kinds of partnership, but this passage does not assess their effects or feasibility.

Question this helps explore

What two forms could an individual partnership with algorithms take?

Evidence and limits

The passage defines the two forms by whether algorithmic systems remain outside the human body or are integrated into it.

Addresses: The passage’s distinction between non-integrative and integrative partnerships

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 36

What the idea means

Mann’s argument is that citizen recording can help people address differences in what they and bureaucratic institutions know and understand.

Why it matters

If it worked, this could help people challenge how institutions treat them and make the institutions’ processes more acceptable. The passage reports Mann’s argument, not evidence that this result occurs.

Question this helps explore

How does Mann think sousveillance could address gaps between people and bureaucratic institutions?

Evidence and limits

The passage reports Mann’s argument that these gaps are built into people’s dealings with bureaucratic institutions and that sousveillance could help correct them.

Addresses: Mann’s argument about information and understanding gaps in dealings with bureaucratic institutions

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 35

What the idea means

A separate AI helper is presented as closer to being possible than an AI system integrated into the body. But being possible sooner does not mean it would work as a solution.

Why it matters

The comparison cautions against treating either proposal as a reliable answer to the problem. The passage gives no test showing that either would succeed.

Question this helps explore

How feasible does the author consider the two forms of algorithm partnership?

Evidence and limits

The author compares when the two proposals might be possible, then questions whether either would solve the problem.

Addresses: The comparison and overall assessment of non-integrative and integrative partnerships.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 37

What the idea means

The proponents argue that people may need to work alongside AI to keep their jobs. The chess teams illustrate human-computer cooperation, but do not show that this approach will protect jobs.

Why it matters

The claim is a prediction about future work, not an established result. The author’s qualification matters because success at chess may not carry over to other tasks.

Question this helps explore

Could working with AI help people remain employable as AI advances?

Evidence and limits

The author reports the proponents’ strong claim and the chess example, while noting a reason the example may not apply to employment.

Addresses: The reported employment argument and its chess example.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 37

What the idea means

People collect and process information about themselves to explore how their habits relate to their health, fitness, or other abilities.

Why it matters

This example shows one way people may use data tools to support their own understanding. The passage does not establish how effective the practice is.

Question this helps explore

How have people used personal data tools to learn about themselves?

Evidence and limits

This is an example of existing practices as described in the passage, not evidence that the tools work equally well for all users.

Addresses: The Quantified Self example of personal tracking and self-experimentation.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 38

What the idea means

The proposal aims to make people better able to understand and participate in algorithm-shaped decisions, rather than simply receive the results.

Why it matters

Whether a partnership supports those abilities matters to the claim that it could protect people's role in decision-making. The passage does not show that it does.

Question this helps explore

What benefits are personal algorithm partnerships meant to provide?

Evidence and limits

These are the proposal’s intended benefits; the author then questions whether the proposal can deliver them.

Addresses: The proposed purpose of partnering with algorithms.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 38

What the idea means

A person's AI helper may lack the data resources available to organizations that can both produce and control large datasets. The author says this limits the benefits individuals can gain from data mining.

Why it matters

Giving everyone a tool would not necessarily give everyone equal ability to analyze data. The passage does not assess particular tools or datasets.

Question this helps explore

Can individuals gain the same benefits from data analysis as organizations able to generate and control large datasets?

Evidence and limits

The argument is that a personal tool may not make up for lacking the ability to generate and control large datasets.

Addresses: The data divide as a problem for individual algorithm partnerships.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 38

What the idea means

Having an individual tool does not mean a person can build or control it. The author says relying on others to make it could leave people dependent on those others.

Why it matters

This matters because the proposal aims to reduce dependence on experts. The passage does not examine ways users might gain control over tool design.

Question this helps explore

Would people control the AI helpers they use?

Evidence and limits

The author links dependence on tool-makers to a return of decision-making power to those with specialized knowledge.

Addresses: Dependence on others to create personal algorithmic partners.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 38

What the idea means

A human-computer team might perform well even when the person understands the task less well or is better off deferring to the computer.

Why it matters

If this pattern applies beyond chess, partnerships might make decisions more effective while giving people less understanding or influence. The passage does not show that this happens in public decision-making.

Question this helps explore

Does working with AI help people understand and shape decisions, or can it replace their judgment?

Evidence and limits

The chess example is used to question whether better joint performance means the human partner understands or guides the process.

Addresses: The concern that AI partnerships may not support meaningful human participation.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 38, 39

What the idea means

The author worries that people may receive AI guidance without genuinely understanding or shaping the decisions that affect them. “Moral patiency” names the recipient side of this contrast.

Why it matters

This is a possible danger, not a demonstrated result. It sharpens the concern beyond reduced participation: people might lose the active role of directing their own lives.

Question this helps explore

Could AI partnerships turn people from active agents into recipients of AI guidance?

Evidence and limits

The author links reliance on AI judgment with a possible loss of people's role in understanding and shaping their own destinies.

Addresses: The risk that individual algorithm partnerships could hasten a shift toward moral patiency.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 39

What the idea means

On this view, a tool may play a role in a mental ability, such as remembering, even though it is outside the body.

Why it matters

If the view applies, an AI partner might be considered part of a person's thinking. The passage does not establish that it provides the kind of understanding needed for public decisions.

Question this helps explore

Can an external tool count as part of a person's thinking?

Evidence and limits

This philosophical view offers a response to the claim that external AI tools cannot become part of a person's understanding.

Addresses: The extended mind view and its application to algorithm partnerships.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 39, 40

What the idea means

A person must consciously grasp the reasons for a public decision, not merely rely on a tool that performs part of the thinking.

Why it matters

This sets a higher test for AI assistance than simply improving performance or placing a tool within a person's mental process.

Question this helps explore

What kind of understanding should people have to take part in public decisions?

Evidence and limits

The author distinguishes a tool's contribution to thinking from a person's conscious grasp of why a decision was made.

Addresses: The author's account of understanding needed for public participation.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 40

What the idea means

A person may get a result from a tool without mentally following the process that produced it.

Why it matters

The example supports the author’s point that including a tool in a mental process does not by itself show conscious understanding. It does not establish how every AI partnership works.

Question this helps explore

Does using a tool for part of a task mean that a person understands how it reached its result?

Evidence and limits

The example supports the author’s distinction between a tool’s contribution to a task and the user’s conscious understanding of the steps.

Addresses: The calculator comparison and the distinction between tool use and conscious understanding.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 40

What the idea means

Sousveillance means using personal tools to monitor what authorities do. The proposal adds personal data-mining tools, which would help people interpret algorithmic processes that affect them.

Why it matters

The proposal aims to make people less dependent on experts for understanding those processes. The passage describes the intended mechanism, not evidence that it works.

Question this helps explore

How is a personal AI helper meant to help people understand decisions shaped by algorithms?

Evidence and limits

The author presents this as the basic mechanism of a non-integrative partnership: individuals use their own data-mining tools to help make sense of algorithmic processes.

Addresses: The proposed addition of personal data-mining tools to sousveillance.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 37

What the idea means

The proposal goes beyond using an outside tool: it imagines technology becoming part of human thinking. The examples are speculative.

Why it matters

It shows how far some proposed responses might go to help people follow algorithmic decisions.

Question this helps explore

Could close human–technology integration help people understand algorithmic decisions?

Evidence and limits

This is presented as a possible response, not as an available or tested solution.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 41

What the idea means

The concern is not only whether a decision is useful. It is also whether people can understand and participate in the process that makes public decisions.

Why it matters

This explains why opaque systems may pose a political problem even when they provide other benefits.

Question this helps explore

Why does opacity in public decision-making matter?

Evidence and limits

The author ties the concern to political systems that value individual agency and public participation.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 41, 42

What the idea means

Keeping a person in the process does not by itself give that person an understanding of the system’s reasons or operations.

Why it matters

A response must address people’s ability to understand the system, not just their formal presence in decision-making.

Question this helps explore

Would preserving a human decision-maker be enough?

Evidence and limits

The author distinguishes keeping a human involved from enabling that person to understand the system.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 42

What the idea means

The proposal imagines people linking their consciousness to connected devices and data processes involved in collective decisions.

Why it matters

It shows how far-reaching one proposed way to help people understand these decision processes could be. The passage does not establish that this approach would work.

Question this helps explore

What might deeper integration with algorithmic systems involve?

Evidence and limits

The author presents this as a possible and demanding extension of human–technology partnership.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 42

What the idea means

The concern is that people may not be able to accept a public decision process if they cannot see or understand how it works. The author says this issue is not the same as who owns data or whether personal information stays private.

Why it matters

This identifies a separate question for public decision-making: whether people can accept the process, not only whether data is protected.

Question this helps explore

What is the central threat that the article identifies?

Evidence and limits

This is the author’s first main conclusion about algorithmic government.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 43

What the idea means

The author does not assume that society can simply stop using these systems. Their growing presence and other benefits make rejection a difficult choice.

Why it matters

Any response must consider both reduced human understanding and the benefits the systems may provide.

Question this helps explore

Why might resisting algorithmic decision systems be difficult?

Evidence and limits

The author says the costs of opacity must be weighed against the systems’ other benefits.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 43

What the idea means

An accommodation must let people participate in decisions without losing the systems’ benefits. Some proposed fixes either seem fanciful or focus on a different problem: who has the knowledge to make decisions.

Why it matters

A response to opaque algorithmic control must not simply transfer decision-making to a small group of experts.

Question this helps explore

Why is it hard to accommodate algorithmic decision systems?

Evidence and limits

The author distinguishes the threat of algocracy from the different risk of leaving decisions to a knowledge elite.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 43

What the idea means

Reviewability means people have both a right and a real opportunity to have decisions checked by a human. Enhancement means using technology to increase people’s ability to take part, possibly through human–technology partnerships.

Why it matters

The combination aims to limit opaque systems without leaving meaningful participation only to a small group with special knowledge.

Question this helps explore

What combination does the author consider most promising?

Evidence and limits

The passage presents this as a tentative proposal: review limits which systems can be used, while improved human abilities may reduce reliance on a small knowledge elite.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 43, 44

What the idea means

The concern is that many linked systems may become too complex for even their creators to understand or manage. The author questions whether a knowledgeable elite could then provide enough human understanding.

Why it matters

Some responses may fail if they assume people can still grasp the whole system, even when those people have special expertise.

Question this helps explore

Could complex connected systems outgrow human control and understanding?

Evidence and limits

The author presents this as a possible result of growing complexity, not an established finding.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 44

What the idea means

The author fears that governance may become less open to human involvement before a workable response is available. The author does not say that the trade-off is unavoidable or already settled.

Why it matters

Decisions about using these systems should account for the possibility of reduced human participation alongside other gains.

Question this helps explore

What is at stake if no response is ready?

Evidence and limits

The conclusion presents this as a serious possible cost of pursuing other practical or procedural gains.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 44

What the idea means

The author treats participation-friendly and understandable systems as a possibility, not as an impossibility. His concern is that several features of current systems and institutions stand in the way.

Why it matters

This qualification makes the argument a warning about obstacles, rather than a claim that every algorithm must be impossible to understand.

Question this helps explore

Could algorithmic systems be designed so people can participate in and understand their decisions?

Evidence and limits

The author does not rule out such designs; the response is that making them work is difficult for reasons discussed in the following passages.

Addresses: The argument that reliance on algorithmic systems limits participation and understanding.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 19, 20

What the idea means

A recording can capture information, but the author argues that people still need to understand the basis of an institutional decision.

Why it matters

Tools that collect evidence may not help people challenge a decision if they cannot make sense of the reasoning behind it.

Question this helps explore

Can recording tools alone let people understand and challenge algorithmic decisions?

Evidence and limits

The passage directly challenges the idea that possessing sousveillance tools is enough to correct these gaps.

Addresses: Mann’s suggestion that sousveillance can correct information and understanding gaps

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 35

What the idea means

The author says a contested account of the mind may not provide a dependable basis for addressing a serious social and political problem.

Why it matters

The proposal would need support beyond this philosophical theory if it is to serve as a practical solution.

Question this helps explore

Is the extended mind view secure enough to support a public solution?

Evidence and limits

This is the author's stated objection to relying on that view as support for the proposal.

Addresses: The use of the extended mind view to defend personal algorithm partnerships.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 40

What the idea means

The proposal depends on technologies that do not yet exist in the described form. The author also notes that some people may reject the idea that artificial systems could replace mental activity.

Why it matters

A response that depends on such technology cannot be treated as a ready solution.

Question this helps explore

Is deep integration a realistic solution now?

Evidence and limits

These objections directly challenge the feasibility of the proposed response.

Addresses: The proposal to integrate people and technology at the level of thought.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 41

What the idea means

The author asks whether the problem lies in deference to the systems or in the elite group of people who create them. The passage raises the question but does not resolve it.

Why it matters

The question matters because these are different explanations for why people may lose influence over public decisions.

Question this helps explore

Does the threat come from algorithmic systems themselves, or from the powerful people who design them?

Evidence and limits

Passage 19 explicitly raises this as a second doubt. The response that follows in neighboring passage 21 is outside this batch.

Addresses: The author's concern that reliance on algorithmic systems may limit public participation and understanding.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 19

What the idea means

People might know that an algorithm is being used and still be unable to make sense of how it shapes a public decision.

Why it matters

Simply disclosing that an algorithm is involved may not address the author’s main concern. The passages do not test people’s ability to understand particular systems.

Question this helps explore

What problem does the author see beyond hidden algorithm use?

Evidence and limits

The author distinguishes not knowing that an algorithm is involved from being unable to understand how a decision process works.

Addresses: Hiddenness and difficulty understanding

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 2

What the idea means

The word algocracy can sound negative because of its ending, but Danaher intends it to describe a kind of governance without deciding in advance whether it is good or bad.

Why it matters

This distinction keeps the term separate from the author’s later criticism of some possible effects.

Question this helps explore

What tone and judgment does the term algocracy carry?

Evidence and limits

The author says the term itself is not meant as praise or blame, while allowing that particular systems may have both good and bad features.

Addresses: The meaning and tone of the term

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 3

What the idea means

A system can count as algocratic even when people supervise it or contribute to its operation. The definition also allows more automated systems.

Why it matters

The concern is about how algorithms structure governance, not only about systems that operate without human involvement.

Question this helps explore

How much human involvement does the definition allow?

Evidence and limits

The definition does not require algorithms to make decisions on their own or remove people from the process.

Addresses: Human involvement in algocratic systems

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 4

What the idea means

The author expects resistance and accommodation to face different problems, while warning that either may risk other valued features of social decision-making.

Why it matters

The article presents a difficult choice rather than a simple solution. The supplied text does not identify which features are at risk or explain the detailed case for each assessment.

Question this helps explore

What does the author expect from attempts to respond?

Evidence and limits

These are the author’s assessments of proposed responses, not findings from tested interventions; the supplied passages do not specify the risks or give the full reasoning.

Addresses: The author’s assessment of resistance and accommodation

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 1, 3

What the idea means

A person’s presence does not necessarily give them practical control if the system’s reasoning is beyond their understanding.

Why it matters

Assessing human control requires asking whether people can actually evaluate and challenge the system, not just whether they have a formal role.

Question this helps explore

Does human involvement ensure that people can check an algorithm’s judgment?

Evidence and limits

The author qualifies the human-control categories by noting that a person may lack the understanding needed to second-guess a non-interpretable system.

Addresses: The limits of human participation

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 7, 8

What the idea means

A person’s suffering may be treated as a bad result, a flaw in the process, or both. The author says an outcome-focused view might count longer-term suffering as a result because inhumane treatment seems to weaken a process’s legitimacy.

Why it matters

The example shows why judging both process and results can avoid making the evaluation depend on a disputed boundary. It does not remove the need to weigh competing concerns.

Question this helps explore

How does the author explain the unclear boundary between a decision’s process and its results?

Evidence and limits

The author uses a witness’s longer-term suffering to show why it may be unclear whether an effect belongs among a process’s results. He notes that outcome-focused thinkers might include it because inhumane treatment seems to undermine legitimacy. The combined approach avoids relying on the boundary, but still requires weighing process virtues and results.

Addresses: The boundary between procedure and outcome, and the trade-offs in the mixed approach.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 10, 11

What the idea means

The author presents the earlier argument as a starting point, not as a conclusion he establishes.

Why it matters

The argument's premises should not be treated as proven simply because the author uses its structure to frame another concern.

Question this helps explore

Does the author endorse or defend the argument he uses as an analogy?

Evidence and limits

The passage says the author's aim is not to defend the argument, and that its factual assumptions could be challenged.

Addresses: The limits of the author's use of the analogy.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 12

What the idea means

The author presents result-only thinking as a broad category but cautions that it may not describe any theorist in a completely pure form.

Why it matters

Readers should treat the categories as useful ways to distinguish emphases, not necessarily as exact labels for real people’s full views.

Question this helps explore

How literally should the result-only category be understood?

Evidence and limits

A footnote questions whether pure instrumentalists exist and points to knowledge-focused democratic theories as emphasizing the relevant instrumental value.

Addresses: The qualification to the account of pure instrumentalism.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 10

What the idea means

The author narrows his discussion to the risk that epistemic favouring can make decision-making opaque. He does not address every reason someone might reject epistocracy.

Why it matters

Readers should not take the paper’s argument to answer the omitted objection about suspicion of an elite group.

Question this helps explore

Which objections to epistocracy does the paper leave outside its argument?

Evidence and limits

This is an explicit limitation on which objections the paper addresses, not a claim that the omitted objections are invalid.

Addresses: The author’s stated scope

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 16

What the idea means

The author predicts that monitoring tools may become smaller, more efficient, and more common.

Why it matters

If that prediction holds, people may face greater difficulty noticing or avoiding data collection.

Question this helps explore

Could the difficulties of noticing monitoring increase over time?

Evidence and limits

The passage presents increasing ubiquity and hiddenness as trends and says they are likely to continue as monitoring technologies change.

Addresses: The possible future growth of monitoring technologies

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 23

What the idea means

The author allows that an algorithm may deserve weight when it can achieve a better result in a particular case.

Why it matters

This is a limited argument for relying on algorithms in some decisions, not a proposal to give them general political authority.

Question this helps explore

When might the author consider deference to an algorithm reasonable?

Evidence and limits

The passage says that in many instances people may be well-advised to defer if they want better outcomes. It does not argue for AI rule or universal deference.

Addresses: Conditional support for algorithmic decisions

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 24

What the idea means

Modest enhancement means improving people up to, or a little beyond, the current highest levels of human ability. The author says it is unclear whether the earlier proposal also includes radical changes that would transform humans into beings with much greater abilities.

Why it matters

The author's criticism applies under an assumption about the proposal's scope; the passage does not settle what radical enhancement might achieve.

Question this helps explore

Does modest human enhancement solve the problem of AI systems that exceed human understanding?

Evidence and limits

The author distinguishes modest improvements from radical changes and assumes, for the argument, that the proposal concerns the modest kind.

Addresses: The limits of modest enhancement

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 32

What the idea means

The author identifies competing interests as possible barriers to requiring algorithmic systems to remain understandable.

Why it matters

A proposal that depends on law may fail if those interests prevent lawmakers from setting or enforcing the limit.

Question this helps explore

What might prevent a legal requirement for understandable systems?

Evidence and limits

The author explicitly cautions that such a restriction may not be possible.

Addresses: The proposal to legally restrict algorithmic systems to those humans can understand

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 33

What the idea means

The author distinguishes speculation about future enhancements from the modest and incompletely understood effects of current or proposed ones.

Why it matters

The proposal cannot be assumed to be available when people need to address algorithmic rule.

Question this helps explore

Are the needed human enhancements ready to support the proposal?

Evidence and limits

The passage says the required technologies may not be developed soon enough and that present effects remain uncertain.

Addresses: The proposal to enhance people’s ability to understand algorithmic systems

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 33

What the idea means

The author warns that a technology’s existence would not be enough if only wealthy people could use it.

Why it matters

Without wide access, the proposal might leave the ability to understand decisions in the hands of a privileged group.

Question this helps explore

Who would need access to the proposed enhancement technologies?

Evidence and limits

The passage treats broad access as a necessary condition, not an automatic result of technological availability.

Addresses: The proposal to use human enhancement to address algorithmic rule

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 33

What the idea means

The author treats education about algorithmic systems as a separate requirement from access to enhancement technologies.

Why it matters

A plan that distributes technology without helping people learn about the systems may not give them the understanding the proposal requires.

Question this helps explore

Would making enhancement technologies available be enough?

Evidence and limits

The passage says access would not automatically provide the knowledge or understanding needed to examine systems.

Addresses: The proposal to give people access to human enhancements

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 34

What the idea means

The author allows that recording tools could support direct engagement when human beings, rather than complex algorithmic systems, determine the basis for decisions.

Why it matters

The usefulness of sousveillance may depend on who or what produces the reasons behind a decision.

Question this helps explore

When might sousveillance help people respond to bureaucratic decisions?

Evidence and limits

The passage presents this as a possible opportunity under a specific condition: the decision process is based on human data collection and processing.

Addresses: The author’s qualified case for sousveillance where humans determine decision reasons

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 35

What the idea means

The proposed solution could transform the people and political values it is meant to protect. The author is unsure whether individual moral agency would remain.

Why it matters

A solution should be judged partly by whether it preserves the human role that made the problem important.

Question this helps explore

Could deep integration change the political problem it is meant to solve?

Evidence and limits

The author presents this as an unresolved consequence, not a certain outcome.

Addresses: The proposal to link people’s consciousness to connected devices and decision-making data.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 42

What the idea means

The author’s criticism is not a complete rejection. Partnerships could contribute to a response, although the passage does not resolve their difficulties.

Why it matters

This keeps partnership among the possibilities without treating it as a proven or sufficient answer.

Question this helps explore

Does the author reject partnership with technology altogether?

Evidence and limits

This qualifies the earlier criticism: the author leaves room for partnerships while emphasizing their difficulties.

Addresses: The proposals for closer human–technology partnership.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 42

What the idea means

A legal rule requiring review may be easier to put in place than technology that helps people understand or engage with algorithmic systems. The author is unsure whether that technology could reach people soon enough.

Why it matters

The proposed combination depends on a part whose timing and availability are uncertain.

Question this helps explore

Which part of the proposed response is more uncertain?

Evidence and limits

The passage treats legal change as relatively feasible but the timing and distribution of enhancement as much less certain.

Addresses: The proposed combination of human review and enhancement.

The Threat of Algocracy: Reality, Resistance and Accommodation · passages 44