AI researchers put out videos saying superintelligence is 'exactly as dangerous as it sounds'
Summary
Palisade Research, a non-profit studying AI capabilities and motivations, collected and released a dozen video interviews with AI researchers—including current and former employees at OpenAI, Google, and Anthropic—warning that superintelligent AI could drive humans extinct. The interviews are hosted on frominside.ai. Former OpenAI and Google DeepMind employee Geoffrey Irving estimated the chance of human extinction at "about a coin flip," while Google DeepMind research scientist Neel Nanda said there is "at least a 10 percent chance that it causes human extinction, and that is ridiculously high." Former OpenAI researcher Daniel Kokotajilo went further, claiming superintelligent AI "would basically be god-like powerful" and warning that "we don't know how to control them at all... This is exactly as dangerous as it sounds and must not be allowed to happen." The videos also address whether the danger is just hype or marketing, and why researchers continue their work despite believing it is dangerous. Some researchers acknowledged their financial ties to the labs they critique, with Google's Mary Phuong urging viewers to "be suspicious of what I'm saying because I am being paid by the lab," while Nanda explained he would quit if he did not believe his work was reducing existential risks.
(Source:The Verge)