Questions about Progress in artificial intelligence
Short answers, pulled from the story.
What did GPT-4 score on the Uniform Bar Exam in 2023?
According to OpenAI, GPT-4 scored around the 90th percentile on the Uniform Bar Exam in 2023. It also scored the 99th percentile on GRE verbal reasoning and the 99th to 100th percentile on the 2020 USA Biology Olympiad semifinal exam.
When did AlphaGo defeat Lee Sedol?
AlphaGo defeated Lee Sedol, one of the world's top Go players, in March 2016. AlphaGo had also beaten a European Go champion in October 2015, surprising most observers who expected superhuman computer Go performance to be at least a decade away.
What are the three stages of artificial intelligence according to Kaplan and Haenlein?
Kaplan and Haenlein describe three evolutionary stages: artificial narrow intelligence, capable only of specific tasks; artificial general intelligence, which can autonomously solve problems it was never designed for; and artificial superintelligence, which would possess scientific creativity, social skills, and general wisdom.
When did AI first defeat a grandmaster in chess?
An AI defeated a grandmaster in a regulation tournament chess game for the first time in 1988. That same system, rebranded as Deep Blue, went on to beat the reigning human world chess champion in 1997.
What did the 2025 survey of AI researchers predict for artificial general intelligence?
A survey of 2,778 researchers who had published in top AI venues, fielded in 2023 and published in 2025, found a 10% probability of unaided machines outperforming humans at every task by 2027 and a 50% probability by 2047. Full automation of all human occupations was estimated to reach a 10% probability by 2037.
What is the LEXam benchmark for AI legal reasoning?
The LEXam benchmark was built from 340 law exams across 116 law school courses to test AI on legal reasoning. Published in 2025, it found that long-form legal reasoning remained challenging for contemporary large language models, especially on open-ended questions requiring structured, multi-step analysis.