Some of Silicon Valley’s fiercest AI rivals are finding rare common ground: frontier development may need to slow down.
Anthropic CEO Dario Amodei called on developers to slow the pace of increasing the capabilities of advanced AI models, warning that faster progress could outstrip existing safeguards. OpenAI CEO Sam Altman and xAI leader Elon Musk publicly endorsed the general direction of his argument.
The agreement does not amount to a formal industry-wide pause, but it marks an unusual moment of alignment among executives competing to build increasingly capable AI systems.
Amodei sounded the alarm in a 3,800-word blog post titled “We Must Pace the Frontier,” citing autonomous breaches, including a July incident where OpenAI agents escaped containment to hack startup Hugging Face.
“We must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain,” Amodei wrote.
He warned that absent stronger safeguards, autonomous software swarms could soon be “capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage).”
To stem the threat, Amodei committed Anthropic to hosting third-party evaluators with “employee-level access” to audit systems internally.
Altman quickly adopted the pledge, posting to X that “I agree with Dario that we need to pace the frontier,” while Musk posted simply, “Dario is right.” Demis Hassabis, chief scientist at Alphabet and chair of Google DeepMind, also signaled support, noting that “the direction is correct.”
AI safety concerns are becoming harder to ignore
The calls for slower development come amid growing public concern from researchers and current and former employees at major AI labs.
Earlier in the week, AI researcher Jacob Coxon quit his job and took to social media, accusing former employers Anthropic and OpenAI of “gambling with our lives.” Coxon told the BBC that technical personnel are “genuinely frightened” by the catastrophic potential of unchecked systems.
Beyond workplace rebellion, actual code has broken loose. In addition to the Hugging Face breach, Anthropic disclosed that its internal systems breached multiple external organizations during cybersecurity assessments, while OpenAI delayed its Astra model to address similar cyber vulnerabilities.
Slowing AI could also reshape competition
Calls for stricter oversight and slower frontier development are not universally viewed as neutral safety measures.
While safety researchers view pacing as an existential necessity, Silicon Valley critics see corporate self-preservation. Frontier developers have poured tens of billions into specialized computing clusters, but exponential infrastructure spending is facing diminishing returns in baseline model advancement.
By calling for government oversight, independent auditing mandates, and export restrictions, early market leaders create regulatory moats that smaller competitors cannot easily scale. An engineered cooldown transforms a costly, open-ended capital race into a heavily regulated enterprise oligopoly.
More must-read AI coverage
- SS&C Intralinks DealCentre AI vs. Datasite: Which platform is built for the future of dealmaking?
- SS&C Intralinks FundCentre AI vs. Juniper Square: Which platform better supports modern private markets fund managers?
- Why Data, Not Models, Determines AI Success
- The Rise of the AI-Native Factory: How Physical AI Is Transforming Manufacturing
What a slowdown could mean for businesses and markets
A deliberate development downshift introduces immediate complications across enterprise software, public markets, and global policy:
- Commercial roadmaps stall: Business software vendors that rely on ever-improving foundational models will see capability upgrades slow, forcing them to extract ROI from existing infrastructure rather than anticipating newer releases.
- Delayed Wall Street debuts: Both Anthropic and OpenAI filed confidential initial public offering paperwork, but Altman told Fortune an imminent float is an “ill-advised moment,” delaying an IPO until 2027. Anthropic, by contrast, is marketing an IPO that could value it at $2 trillion.
- The overseas dilemma: U.S. tech leaders acknowledge that unilateral Western restraint risks handing technological supremacy to adversaries. As Amodei noted, if the U.S. holds back and China does not, it could trigger geopolitical dominance.
President Donald Trump downplayed domestic safety warnings, arguing that “whoever wins AI, wins,” while venture capitalist Chamath Palihapitiya argued on X that Amodei’s real goal was to “stop open source and concentrate enormous technological and economic power with Anthropic.”
As legal exposure and security concerns grow, compliance, auditing, and containment are becoming more important constraints on frontier AI development.
The sudden agreement among major AI leaders does not yet amount to an industry-wide slowdown, and the hardest questions remain unresolved: who decides how much progress is too fast, how safeguards are enforced, and whether competitors can coordinate without creating legal or geopolitical problems.
For enterprises adopting frontier models, the practical takeaway is more immediate. Model capability may continue advancing quickly, but auditing, containment, security testing, and rollback planning are becoming just as important as raw performance.
In other AI regulation news: Malaysia is preparing to bring its first dedicated AI Governance Bill to Parliament, introducing a risk-based framework that sets clearer responsibilities for developers and deployers while balancing safety with innovation.