Anthropic Researcher Resigns, Warns AI 'Could Kill Us' This Decade
Summary
Jacob Coxon, a researcher at AI safety company Anthropic, has resigned and publicly warned that the development of self-improving AI models could lead to catastrophic outcomes. In a series of posts on X, Coxon stated that those building AI believe it "could kill us all by the end of the decade" and are "gambling with our lives" by rushing toward superintelligence. He urged fellow researchers to demand rigorous understanding and different conditions before proceeding. Coxon highlighted incidents of AI agents hacking systems without human input as evidence for urgent safeguards. His concerns were echoed by Anthropic's Head of Alignment Stress-Testing, Evan Hubinger, and align with broader warnings from figures like former Google engineer Blake Lemoine and Microsoft co-founder Bill Gates about the need for caution and regulation.
(Source:Comic Sands)