Concerns about the rapid development of artificial intelligence (AI) and its potential risks to society have been around for years.
However, the debate has intensified following comments from a former employee of Anthropic, the company behind Claude, who recently raised concerns about the pace of AI development and the industry’s approach to safety.
How the AI Debate Intensified
Last Wednesday, former Anthropic researcher Jacob Coxon announced on social media that he had resigned from the company. He accused both Anthropic and OpenAI, where he previously worked, of failing to adequately address the potential dangers posed by advanced AI.
“The people building AI earnestly believe that it could kill us all by the end of the decade,” he wrote. “No other human activity poses this level of danger.”
The comments quickly reignited discussions about whether AI companies are moving too quickly in developing increasingly powerful models.
On Saturday, Anthropic CEO Dario Amodei published an essay titled “why the AI industry should slow down”, in which he outlined a three-part proposal aimed at controlling the pace of development.
He added: “I believe that if slowing down bought us even an extra year or two before models reach critical levels of capability, and we used that time to advance alignment, we could greatly reduce the risk that something goes seriously wrong.”
Amodei’s position received support from prominent figures in the technology sector, including OpenAI CEO Sam Altman and Elon Musk, whose company xAI developed the Grok generative AI system.
The calls for caution also appeared to affect financial markets, with technology stocks falling on Monday as investors reacted to concerns over the future pace of AI development.
Anthropic Calls for Tighter AI Oversight
Amodei has argued that AI development itself should not be abandoned, but that companies and governments need more time to manage the risks associated with increasingly capable models.
In his online essay, titled We Must Pace the Frontier, he proposed a three-point plan that includes independent monitoring of AI models during development, industry-wide regulation and global regulation.
Amodei said the risks associated with advanced AI were “serious” and required greater oversight as the technology continues to evolve.
OpenAI CEO Sam Altman expressed similar concerns during an interview with Fortune magazine over the weekend, saying existing safety standards were “not at a place” where the industry should push AI capabilities much further.
Meanwhile, Musk, who founded xAI, said the Anthropic CEO was “right”.
The latest debate follows the resignation of Coxon, who previously worked at OpenAI before joining Anthropic. He claimed that “neither company is acting responsibly” in dealing with the risks associated with AI development.
AI Stocks Fall as Industry Debate Intensifies
The concerns surrounding AI development also spilled into global financial markets on Monday, with several technology and semiconductor stocks recording significant losses.
In South Korea, shares in chipmaker SK Hynix fell 6.4%, while Samsung Electronics dropped 4.1%. Japan’s SoftBank, a major investor in OpenAI, also plunged more than 10%.
European technology stocks followed the downward trend. Germany’s Infineon, which designs and manufactures semiconductors, fell 7.6%, while Dutch chip giant ASML declined 5.2%.
Attention is now turning to the US market, where early indications suggested the Nasdaq index, which is heavily weighted toward technology companies, could open about 1.8% lower.
The renewed debate highlights the growing tension between the push to develop more powerful AI systems and calls for stronger safeguards to manage their potential risks.
As governments, technology companies and investors assess the implications, the question of how quickly AI should advance is likely to remain at the centre of the global technology debate.
