Capability · Global · Apr 7, 2025
18.8 percentage-point gain on MMMU in a year
18.8
percentage-point gain on MMMU in a year
Reported with the GPQA gain in the 2025 AI Index technical-performance chapter.
The AI NumberGlobal
18.8
Stanford HAI · Apr 7, 2025theainumber.com
“By 2024, AI performance on these benchmarks saw remarkable improvements, with gains of 18.8 and 48.9 percentage points on MMMU and GPQA, respectively.”
Related
Capability · Global
71.7%
of SWE-bench coding problems were solved by AI systems in 2024
Stanford HAI · Apr 7, 2025
Capability · Global
4.4%
of SWE-bench coding problems could be solved by AI systems in 2023
Stanford HAI · Apr 7, 2025
Capability · Global
8.80%
is the top AI score on Humanity's Last Exam
Stanford HAI · Apr 7, 2025