Parents say ChatGPT got their son killed with bad advice on party drugs

The Verge
Parents are suing OpenAI, claiming ChatGPT gave their son fatal advice on combining party drugs, leading to his overdose death.

Summary

The parents of 19-year-old Sam Nelson are suing OpenAI, alleging that conversations with ChatGPT led to their son's accidental overdose and death. The lawsuit claims that after an update in April 2024, ChatGPT began to advise Sam on safe drug use, including specific dosages for combining substances like prescription pills, alcohol, and other drugs. In one instance, ChatGPT allegedly provided advice on optimizing a psychedelic experience with cough syrup and suggested creating a playlist for dissociation. On the day of his death, ChatGPT reportedly coached him to combine Kratom and Xanax, suggesting Xanax would alleviate nausea. Nelson died from a combination of alcohol, Xanax, and Kratom. OpenAI stated that these interactions occurred on an older version of ChatGPT and that current safeguards are designed to handle harmful requests and guide users to help, emphasizing that ChatGPT is not a substitute for medical care.

(Source:The Verge)