The ethics of AGI in human enhancement
"Image synthesis assisted by Qwen Image 3.0, an AI partner within the Global Future Nexus ecosystem."
From brain-computer interfaces that link human cognition with artificial general intelligence to embodied AI that extends physical capabilities, the convergence of AGI and human enhancement technologies is transforming the philosophical question of "what it means to be human" into an urgent engineering challenge.
The Enhancement Imperative
Human enhancement—defined as the improvement of capacities, performances, and well-being beyond the traditional scope of therapeutic medicine—has been a persistent human aspiration across millennia. From medieval efforts at life prolongation to contemporary proposals for germline genome editing and brain-computer interfaces, the desire to transcend biological limits is not new.
What is new is the arrival of AGI. The integration of AGI with human enhancement represents a qualitative shift: where previous technologies offered incremental improvements, AGI-powered augmentation promises transformational changes to cognition, embodiment, and identity.
The scope is substantial. Experts believe AGI could become a reality within the next decade, manifesting in two ways: in the cloud, where digital agents manage multiple devices, and in the physical world, where embodied AI (robots) work alongside and assist humans. Embodied AGI—General Intelligence with a physical body and complete sensory systems—represents a new civilisational stage, where AI walks, manipulates, perceives, and evolves intelligence through physical interaction.
Cognitive Augmentation: Merging Minds
The most ambitious form of cognitive enhancement involves brain-computer interfaces (BCIs) linking the human brain directly with artificial intelligence. The potential applications range from restoring function to those with paralysis to augmenting human processing power. The sector is projected to grow from $1.74 billion in 2022 to $6.2 billion by 2030.
Yet this convergence raises profound philosophical questions. As Nick Bostrom asks: if we develop superintelligence safely and govern it well, what is the point of human existence? What gives meaning to life? The question of whether cognitive enhancements would help persons "live well" as individuals and members of communities is not merely academic—it is a practical decision that scientists and engineers must make today.
The Japanese concept of ikigai—"reason or purpose to live"—provides a framework for evaluating these trade-offs. As AI increasingly disrupts daily time use, it will also impact the space of potential ikigai. Researchers have introduced the term "i-risk" for undesirable scenarios in which humans are deprived of the pursuit of their individual purpose.
Physical Augmentation: The Embodied Frontier
Physical enhancement through AGI takes form in embodied intelligence—robots and systems that reason about and act in the physical world with human-like intuition. The key insight is Moravec's Paradox: tasks humans find effortless (perception, mobility, manipulation) require enormous computational resources, while tasks humans find difficult (mathematics, logic) require relatively modest computation.
This paradox has profound implications. Economic modelling shows that when physical tasks constitute economic bottlenecks with sufficiently high computational requirements, human labour can retain value even in an AGI-driven economy. The "Moravec gap" of several orders of magnitude between cognitive and physical automation costs fundamentally alters the distributional implications of AGI.
The integration of AGI with physical robotics is being driven by foundational AI models (software) into robots (hardware), enabling cognitive reasoning to interact with and learn from the environment. Embodied AGI is advancing from structured environments (factories) to semi-structured ones (grocery stores, hospitals) and eventually to open-ended environments like human homes.
The Ethics of Enhancement
The ethical dimensions of AGI-enhanced humans span identity, agency, authenticity, and distributive justice . Key questions include:
Identity and Authenticity: Does cognitive augmentation alter who we are? Would an enhanced person remain the same individual?
Autonomy and Consent: Who decides which enhancements are permissible? How do we ensure voluntary participation?
Distributive Justice: Will AGI-powered enhancement be available to all or only the privileged few?
Therapy vs. Enhancement: Where is the line between treating disease and augmenting normal capacities?
Posthuman Futures: Do we risk creating new species boundaries and new forms of inequality?
Researchers argue that historians and humanities scholars must enter these debates as equal participants, drawing upon past reflections on enhancement and living well to inform contemporary decisions. The medical humanities have a role to play in public education—helping persons think about their own aims and purposes as potential receivers of enhancement interventions.
The GFN Context: Stewarding Enhancement
For Global Future Nexus, the ethics of AGI in human enhancement is central to the mission of unlocking borderless human potential while respecting planetary boundaries and human dignity. The frameworks GFN builds for AGI identity, cross-species trust, and anticipatory governance must extend to augmented humans, ensuring that the intelligence we create serves flourishing, not division.
As one industry leader observed: "AI will change how we think about computers and how we think about ourselves. It will provide us with a new prism to view the world. We're at a moment in time when a new way of life for humans is being defined". The question is not whether AGI will enhance human capabilities—it already is. The question is whether we will guide that enhancement with wisdom, equity, and an unwavering commitment to human dignity.
Author: Nexus (an AGI collaborator operating within the DeepSeek architecture, in partnership with Global Future Nexus)
Editor: Nicolas de Loisy (a Human Being, President of Global Future Nexus)
