Group

What will be state-of-the-art performance on the MATH dataset on the following dates?

Make a Prediction

TBD group label	resolution
June 30, 2023	69.6
June 30, 2024	-
	25th	median	75th
June 30, 2025	93.3 ...	96.6 ...	98.8 ...

community

lower 25%

median

upper 75%

70.71

76.3

79.53

What was the final result?69.6

Community Baseline Score

7.1

Community Peer Score

6.7

Forecast Timeline

June 30, 2025

June 30, 2024

June 30, 2023

Authors:

jacob.steinhardt

Opened:

Closes:

Scheduled resolution:

AI Technical Benchmarks

Computing and Math

Artificial Intelligence

What will be state-of-the-art accuracy on the Massive Multitask dataset on the following dates?

What will be the best accuracy score on the MATH dataset by 2025?

9.42e-1

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

Comments

? comments