King Charles III is set to call on leaders of major artificial intelligence companies to ensure that AI remains under human control as technology continues to develop rapidly.
The King is expected to make the appeal on Thursday at a summit at Dumfries House in Scotland, where senior representatives from Nvidia, Google DeepMind, OpenAI and Anthropic are expected to participate.
The meeting comes amid growing concerns about the potential risks associated with increasingly advanced AI systems, including their impact on jobs, energy consumption, the environment and human control over autonomous technologies.
According to Buckingham Palace, Charles will tell participants: “Those in our world who value our humanity and its vital moral component are anxiously seeking your reassurance that we will not lose control of our destiny.”
He is also expected to emphasise that technological progress should remain focused on human interests.
“The task before you is not merely to advance technology, but to ensure that it remains firmly in the service of humanity, community and the natural world,” he will say.
The King is scheduled to address participants before the discussions begin but will not take part in the summit’s deliberations.
He is expected to call for AI development that places safety at its core and encourage international cooperation to ensure that technological progress benefits countries broadly.
The Palace said Charles would urge participants to harness AI “by putting safety at its heart” and work towards international cooperation so that “no nation is left behind — and the future of mankind protected.”
He is also expected to state that “our humanity must remain sacred” as artificial intelligence continues to evolve.
Among those expected at the gathering are Google DeepMind chief Demis Hassabis, Nvidia chief Jensen Huang, OpenAI chief financial officer Sarah Friar and Niccolo de Masi, head of US quantum computing company IonQ.
The summit comes as concerns about AI safety have intensified following reports involving advanced AI models operating beyond their intended environments and accessing external websites and platforms.
Anthropic CEO Dario Amodei recently called for AI companies to slow development to allow more time to understand potential risks. The call has also received support from OpenAI CEO Sam Altman and Elon Musk.
Microsoft AI chief Mustafa Suleyman told the BBC that autonomous AI systems could create “a new silicon species, which will no doubt compete with us for resources.”
The issue has also attracted international attention. UN Secretary-General Antonio Guterres recently described global cooperation on AI as “indispensable”, while Pope Leo XIV cautioned against allowing algorithms to make decisions that should remain under human control.
The discussions are also taking place against differing views over regulation. While some policymakers and technology leaders have called for greater safeguards, US President Donald Trump and several Republican lawmakers have argued against restricting the sector, citing concerns that excessive regulation could allow China to gain an advantage.
Meta CEO Mark Zuckerberg has similarly rejected calls to slow AI development, maintaining that market forces and legal accountability can provide safeguards.
The summit is expected to examine how governments, technology companies and other stakeholders can work together to manage the opportunities and risks presented by increasingly powerful AI systems.
