Emily M. Bender and colleagues published a paper in 2021 titled On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? The document introduced a metaphor describing large language models as systems that statistically mimic text without real understanding.
Timnit Gebru faced pressure from Google regarding her co-authored research on AI risks, and Jeff Dean stated the paper did not meet publication standards for the company. Shortly after, an email informed Gebru that Google accepted her resignation following a conflict over transparency and internal criticism.
In 2023, the American Dialect Society designated the term as the AI-related Word of the Year. Public discourse increasingly framed discussions around whether machines truly comprehend language or merely mimic patterns.
Large language models occasionally synthesize information matching certain patterns while presenting false facts as truth because they lack any reference to actual meaning behind the words they generate. Such failures suggest models cannot connect words to world comprehension like humans do when datasets contain poor quality information.
In 2023, some large language models achieved strong results on SuperGLUE tests for common sense and language understanding with GPT-4 scoring within the top range of the Uniform Bar Examination. A 60 Minutes interview in 2023 featured Geoffrey Hinton claiming accurate prediction requires sentence comprehension and logical puzzles demonstrated by researchers show models solving novel tier-four mathematics problems with coherent proofs.