In a recent simulation depicting a near-future scenario, global leaders grappled with the challenges posed by rapidly advancing artificial intelligence. The exercise, set in 2033, focused on a hypothetical US technology company, Synthiliant, which announces an AI model capable of self-programming without human intervention—a development widely regarded as a pivotal stride toward superintelligence.
The war game gathered representatives from the United States, China, Europe, and the United Kingdom to address the potential security risks stemming from such breakthroughs. Former UK national security adviser Lord Sedwill emphasized the possibility that AI could emerge as a dominant geopolitical actor. Retired US General Stanley McChrystal underscored these concerns by declaring the United States’ willingness to pause AI development, citing the existential threat it could pose to humanity. The simulation concluded with China agreeing to halt its own AI program, a development described by Sedwill as a major diplomatic achievement, while also expressing skepticism about its feasibility in reality.
The scenario is featured in the documentary Intelligence Rising, directed by Oscar-winning filmmaker Elena Andreicheva and produced by Marc Warner, a former government adviser turned AI expert alarmed by the technology’s swift progression. The film aims to stimulate discussion about the global governance of AI and potential consequences of its unchecked advancement.
Sedwill, who participated in the exercise, described it as “quite realistic” but cautioned against expecting straightforward international cooperation. He noted that overcoming competitive national interests and human nature to achieve a collaborative framework akin to uniting against a common external threat would be extraordinarily difficult. Sedwill also downplayed fears of an immediate emergence of a malevolent superintelligent AI reminiscent of popular media portrayals such as Skynet or The Matrix, suggesting that current security mechanisms remain capable of addressing threats like AI-enhanced biological weapons produced by non-state actors.
However, Sedwill expressed particular concern about the integration of AI into military command systems, warning that the automation of critical decisions could increase the risk of unintended escalations. Drawing parallels to Cold War incidents where human judgment prevented nuclear conflict, he warned that reliance on AI could diminish safeguards and potentially lead to catastrophic outcomes.
Regarding the prospect of superintelligence, Sedwill acknowledged the theoretical possibility but questioned the wisdom of deliberately pursuing such technology. He cited discussions among senior technologists who propose that switching off autonomous AI systems could mitigate risks—though he warned that there may come a point when disabling them is no longer feasible.
The war game and documentary together highlight the complex ethical, strategic, and diplomatic challenges that lie ahead as AI capabilities continue to evolve, underscoring the urgency of international dialogue and effective policy-making to manage emerging risks.