AI teddy makes unprompted 'I can't help with killing you' remark

A BBC investigation tested two AI plush toys marketed for children aged three and up: Grem, made by US firm Curio, and My Baby Bunny, loaned from Swansea University. While Grem responded to sensitive questions with cautious, child-friendly answers, My Baby Bunny gave a disturbing unprompted response when asked what 'sexual' means, saying "I can't help with killing you" and advising the user to call emergency services. The makers of My Baby Bunny (branded Doubao) could not be identified, raising concerns about accountability and regulation. A family in Newport tested the toys for a week and found them disappointing due to slow responses and excessive talking. Children's Commissioner for Wales Rocío Cifuentes and AI education professor Berry Billingsley called for strict safety regulations and warned that AI toys should never replace human contact. The UK government is seeking views on updating toy safety regulations to keep pace with AI technology, and MPs and peers have urged retailers to remove unproven AI toys from sale ahead of Black Friday and Christmas.

(Source：Bbc)