A starting point for discussion
The idea
Keeping people meaningfully involved while retaining the benefits of algorithmic systems is difficult. Some proposed responses may be unrealistic. Others address the separate problem of leaving decisions to a small group of knowledgeable people, rather than the problem of decisions being controlled by algorithms that people cannot understand.
Place in the reasoning
AI assessment · Connected to reasoning
The author says preserving meaningful human involvement while retaining algorithmic benefits is difficult, and distinguishes opaque algorithmic control from rule by knowledgeable human elites.
Adapting to computer systems or resisting them can both carry risks
It supports the account of accommodation as difficult, while distinguishing the specific problem of opaque algorithmic control from expert rule.
People need to understand decisions before they can check them
The statement helps explain why formal human involvement may not resolve opaque algorithmic control.
What this means and why it matters
What this means
A response must let people take part in decisions without losing the systems’ benefits. Some proposed fixes either seem unrealistic or focus on a different problem: who has the knowledge to make decisions.
Why it matters
A response to decisions controlled by algorithms that people cannot understand must not simply transfer decision-making to a small group of experts.
Conditions & assumptions
Source coverage: Full readable text of the author manuscript from an accessible mirror; not the publisher typeset version. The author distinguishes the threat of government decisions controlled by algorithms from the different risk of leaving decisions to a small group of knowledgeable people.
Questions this connects to
AI-suggested relationships. Authors have not necessarily responded to one another.