King Charles Urges AI Leaders to Establish Controls Before It’s “Too Late
At a September 17 summit at Dumfries House, King Charles urged AI leaders—including Nvidia’s Jensen Huang and DeepMind’s Demis Hassabis—to establish international controls before irreversible harm occurs. He cited medical benefits but warned of “existential dangers.”
King Charles hosted a private AI summit on September 17, 2026, at Dumfries House in Cumnock, Scotland, calling on technology and government leaders to find ways to control artificial intelligence before it causes irreversible harm.
The gathering brought together some of the most prominent figures in AI and UK government, including Nvidia CEO Jensen Huang, DeepMind’s Demis Hassabis, OpenAI CFO Sarah Friar, Anthropic’s head of global affairs Tino Cuéllar, UK AI minister Kanishka Narayan, the head of the UK’s foreign intelligence service, and Paolo Benanti, who advises the pope on AI.
In remarks that were notable given the royal family’s usual caution around political issues, King Charles acknowledged AI’s potential benefits — citing medicine and science — while warning of serious risks. “AI is already showing immense capacity to improve and save life,” he said. “Yet those who have created these technologies are now increasingly warning that AI risks developing darker capacities, perhaps even to take life.” He urged the room to consider the “existential dangers” of the technology falling into the wrong hands and being used in “potentially catastrophic ways,” asking, “Surely, we need sufficient means of control before it’s all too late?”
The King closed by calling for international cooperation and consensus, saying the task before attendees was “to ensure that it remains firmly in the service of humanity, community, and the natural world.” He stayed approximately 20 minutes before leaving guests to continue discussions.
The summit arrives at a moment of sharp disagreement over AI’s trajectory. This month, OpenAI’s Sam Altman, Elon Musk, and Anthropic’s Dario Amodei called for a slowdown in AI development, while Nvidia’s Huang and President Donald Trump rejected those calls. The summit also follows Anthropic restricting access to its Fable and Mythos models to U.S. customers only, raising concerns about AI sovereignty in Europe.
Cuéllar said Anthropic was honored to participate and grateful to the King for “convening industry leaders and voices from across society to discuss the role of AI in serving the public good.”