Capability · Global · Apr 7, 2025
48.9 percentage points gain on GPQA in a year
48.9percentage points
gain on GPQA in a year
The AI Index reports benchmark gains on MMMU and GPQA between 2023 and 2024.
The AI NumberGlobal
48.9percentage points
Stanford HAI · Apr 7, 2025theainumber.com
“By 2024, AI performance on these benchmarks saw remarkable improvements, with gains of 18.8 and 48.9 percentage points on MMMU and GPQA, respectively.”
Related
Capability · Global
71.7%
of SWE-bench coding problems were solved by AI systems in 2024
Stanford HAI · Apr 7, 2025
Capability · Global
4.4%
of SWE-bench coding problems could be solved by AI systems in 2023
Stanford HAI · Apr 7, 2025
Capability · Global
8.80%
is the top AI score on Humanity's Last Exam
Stanford HAI · Apr 7, 2025