The Road to AGI: Promise, Peril, and Possibility

Why Roadmaps Matter

Artificial General Intelligence (AGI) is unlikely to appear in a single leap. Instead, it will unfold in stages, each bringing new capabilities and new challenges. On this path, researchers and policymakers face a dual responsibility: pushing the technical frontier while ensuring systems remain safe and aligned with human values (Bubeck et al., 2023; Arshi & Chaudhary, 2024).

Development Stages

A helpful way to think about AGI is as a sequence of levels. Level 1, or Embryonic AGI, refers to today’s frontier models, such as GPT-4, which can outperform humans on benchmarks but still rely on curated data and human oversight. Level 2, or Superhuman AGI, envisions systems that can operate independently in real-world environments, solving complex tasks across domains. Level 3, or Ultimate AGI, imagines machines capable of recursive self-improvement, possibly even achieving consciousness-like qualities (Bugaj & Goertzel, 2009; Feng et al., 2024; Mumuni & Mumuni, 2025).

We are firmly in Level 1, experimenting with glimpses of Level 2. Level 3 remains speculative but serves as a powerful horizon for debate.

World Interfaces

AGI’s value will depend not just on abstract reasoning, but on how it interacts with its environment. Digital interfaces enable systems to interact with APIs, databases, and the internet, thereby expanding their reach into knowledge and decision-making (Qin et al., 2024). Physical interfaces enable robots to interact with the world, as demonstrated by projects where language models guide robots to perform step-by-step tasks (Ahn et al., 2022).

These pathways suggest that AGI will not be a disembodied brain, but a networked intelligence capable of acting, sensing, and collaborating across both digital and physical domains.

The road to AGI is not only technical; it is social, ethical and operational.

System Limits

Today’s systems reveal structural limitations that must be addressed before AGI can advance. One issue is hallucination, where models produce fluent but false outputs (Ji et al., 2023a). Another is scaling: achieving broader generalization requires enormous compute power, while efficiency in learning remains elusive. Current systems also lack robustness, struggling with long-context reasoning and unusual tasks.

Unless these bottlenecks are solved, progress from narrow to general intelligence will remain constrained.

Alignment and Ethics

The most critical challenge is ensuring AGI aligns with human goals. Narrow AI can be tuned for specific safety constraints, but AGI’s autonomy raises deeper risks, especially if systems can improve themselves without oversight. Misaligned objectives could lead to unintended or harmful outcomes (Goertzel, 2014).

Ethical alignment will require more than technical fixes. It calls for frameworks that combine transparency, feedback, and governance, ensuring AGI serves human interests even as it grows more powerful.

Navigating the Unknown

AGI would not only change technical systems; it could reshape the structure of work, decision-making, and institutional responsibility. Unlike earlier automation, AGI could affect knowledge labour, creative production, research, governance, and strategic planning. That creates significant opportunity, but also exposes societies to new forms of dependency, inequality, misuse, and loss of control. It also raises unresolved philosophical questions: whether advanced systems could develop self-awareness, whether they could model other minds, and what obligations humans would have toward such entities.

These implications make AGI a social project as much as a technical one. Progress will depend on governance, alignment, transparency, and public debate, not only model capability. The central question is not whether more capable AI can be built, but whether it can be integrated responsibly. Whether AGI becomes a trusted partner or a destabilising force will depend on the choices made before it arrives.