A starting point for discussion
The idea
The author concludes that raising people’s abilities closer to the highest human levels might reduce power differences among people, but would not solve the problem of AI systems that people cannot understand.
Place in the reasoning
AI assessment · Connected to reasoning
This distinguishes reducing power differences among people from solving the separate problem of AI systems exceeding human understanding.
Proposals to improve people’s abilities and require human review have limits
It limits what human enhancement could accomplish: reducing a human expert elite would not by itself make beyond-human systems understandable.
People need to understand decisions before they can check them
The claim challenges the assumption that human capacity-building alone ensures effective review of systems beyond human understanding.
What this means and why it matters
What this means
If people reached very high levels of human ability, that might make it harder for a small group of humans to dominate. But the author argues that this would not let people understand systems whose workings go beyond human abilities.
Why it matters
Reducing unequal power among people and making AI systems understandable are different problems.
Conditions & assumptions
Source coverage: Full readable text of the author’s manuscript from an accessible copy, not the publisher’s formatted version. The continuation of the argument says enhancement might help prevent a human expert elite, while leaving the separate problem of systems beyond human ability. Addresses: The difference between preventing rule by experts and preventing rule by AI.
Questions this connects to
AI-suggested relationships. Authors have not necessarily responded to one another.
How strong is this claim?
AI assessment · not a probability or a final resolution