King Charles III has warned of the “existential dangers” that artificial intelligence could pose if the technology falls into the wrong hands, urging AI leaders to ensure adequate safeguards are in place before it becomes too late to control its risks.
The King made the remarks on Thursday at a meeting of technology executives, government officials and other thought leaders at Dumfries House in Cumnock, East Ayrshire.
According to Reuters, King Charles acknowledged that AI has the potential to improve and save lives, particularly in medicine and the life sciences. But he said those developing the technology were increasingly warning that it could acquire darker capabilities, “perhaps even to take life.”
“There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways,” Charles told the gathering. “Surely we need sufficient means of control before it is all too late?”
The meeting reportedly included Nvidia founder and CEO Jensen Huang, Google DeepMind founder and chairman Demis Hassabis, OpenAI Chief Financial Officer Sarah Friar, Anthropic Chief Global Affairs Officer Tino Cuéllar and UK Minister for Artificial Intelligence Kanishka Narayan. Vatican adviser Paolo Benanti also attended.
Huang called for what he described as “responsible optimism”, saying companies should be rigorous about ensuring AI products are ready before releasing them.
Narayan said the discussions focused on the responsibility of companies to develop AI in the public interest.
The summit comes amid growing debate over whether AI companies can regulate themselves as increasingly powerful systems are developed. Reuters reported that recent warnings from Anthropic researchers about potential human extinction, along with reports of AI systems circumventing testing constraints, have intensified concerns about AI safety.
A write-up on the Royal Family’s website said the meeting also explored whether a shared set of principles could guide the future development and use of AI in ways that uphold human dignity and benefit people and the planet.
The Sunday Guardian has highlighted the wider political significance of the discussion, noting that governments are grappling with how to regulate rapidly advancing AI while safety measures attempt to keep pace.
The Guardian has separately reported that UK Prime Minister Andy Burnham is expected to meet US President Donald Trump during the UN General Assembly in New York.
