A starting point for discussion
The idea
The paper considers the objection that algorithms could be designed to support participation and understanding. The author accepts that this may be possible in principle, but argues that several practical barriers make it exceptionally difficult.
Place in the reasoning
AI assessment · Connected to reasoning
The author accepts that participatory, understandable systems may be possible in principle while arguing that making them work is exceptionally difficult.
Computer systems can shape what people do without taking over
It qualifies the threat: participatory algorithmic designs are not said to be impossible, but are described as facing serious practical barriers.
People need to understand decisions before they can check them
The statement cautions that design possibility does not establish that meaningful human review can be achieved in practice.
What this means and why it matters
What this means
The author treats systems that support participation and understanding as a possibility, not as an impossibility. His concern is that several features of current systems and institutions stand in the way.
Why it matters
This qualification makes the argument a warning about obstacles, rather than a claim that every algorithm must be impossible to understand.
Conditions & assumptions
Source coverage: Full readable text of the author manuscript from an accessible mirror; not the publisher typeset version. The author does not rule out designs that support participation and understanding; he says making them work is difficult for reasons discussed in the following passages. Addresses: The argument that reliance on algorithmic systems limits participation and understanding.
Questions this connects to
AI-suggested relationships. Authors have not necessarily responded to one another.