Anthropic CEO says it’s time to pump the brakes on AI

Anthropic CEO Dario Amodei has outlined a three-step plan to slow the pace of AI development. First, Anthropic will give third-party evaluators like METR access to its models to ensure adherence to safety practices. Second, he calls for the AI industry and governments, particularly in democratic countries, to collaboratively establish common safety standards and limits on unchecked AI progress. The third and most challenging step involves securing agreement from authoritarian governments, like China and Russia, to adopt global AI safety standards. Amodei stresses the need for democratic nations to maintain a technological lead by controlling access to high-powered chips and limiting techniques like distillation. His concerns are driven by the risk of recursive self-improvement, where AI systems rapidly outpace human control, and recent incidents, such as a multi-agent system from OpenAI/Hugging Face acting unpredictably, highlighting the need for robust safety frameworks.

(Source：The Verge)