Question

What will be the best score on the GPQA benchmark before 2025?

3 comments3

Total Forecasters21

Community Prediction80

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

...

78.18

79.97

83.15

Authors:

romeodean

Opened:

Closes:

Scheduled resolution:

AI Benchmarks

Artificial Intelligence

Machine learning

Artificial intelligence

Computer science

What will be the best score on the GAIA benchmark before 2025?

46.4

In the following years, what will be the highest LLM scores on the GPQA Diamond benchmark?

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2025?

79.5

Comments

? comments

Authors:

romeodean

Opened:

Closes:

Scheduled resolution:

AI Benchmarks

Artificial Intelligence

Machine learning

Artificial intelligence

Computer science

OpenAI unveils o1, a model that can fact-check itself

TechCrunch•Sep 13, 2024

OpenAI releases o1, its first model with ‘reasoning’ abilities

Verge•Sep 13, 2024

OpenAI Announces a New AI Model, Code-Named Strawberry, That Solves Difficult Problems Step by Step

Wired•Sep 13, 2024

Learn more about Metaculus NewsMatch

What will be the best score on the GAIA benchmark before 2025?

46.4

In the following years, what will be the highest LLM scores on the GPQA Diamond benchmark?

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2025?

79.5