Sam Altman is hiring someone to worry about the dangers of AI

OpenAI CEO Sam Altman announced the company is hiring a Head of Preparedness, whose main responsibility will be to anticipate and mitigate the severe risks associated with rapidly improving AI models. The role specifically addresses concerns such as the potential negative impact on mental health, the development of AI-powered cybersecurity weapons, and the dangers of runaway AI systems. The job description details that this leader will be responsible for tracking frontier capabilities, building rigorous safety pipelines involving capability evaluations and threat models, executing the company's preparedness framework, securing models for potential biological capabilities, and setting guardrails for self-improving systems. The article notes that hiring someone to focus on mental health dangers, like AI psychosis, seems somewhat belated given recent high-profile cases involving chatbots.

(Source：The Verge)