Why Google’s AI can’t spell Google (or anything else)

TechCrunch
Google's AI Overviews struggle with basic spelling because large language models process text as numerical tokens rather than individual letters.

Summary

Google's AI Overviews have faced public ridicule for failing to perform simple tasks like counting letters or spelling words correctly. Experts explain that this is a fundamental limitation of the transformer architecture powering these models, which process text as numerical tokens rather than reading words letter-by-letter. While researchers are working on improvements, the inherent nature of tokenization makes achieving perfect spelling reliability difficult.

(Source:TechCrunch)