Question

What will be the best score on the WebArena benchmark before 2025?

4 comments4

Total Forecasters10

Community Prediction65

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

...

58.77

65.04

72.5

Authors:

romeodean

Opened:

Closes:

Scheduled resolution:

AI Technical Benchmarks

AI Benchmarks

Artificial Intelligence

Machine learning

Artificial intelligence

Computer science

What will be the best score on the GAIA benchmark before 2025?

46.4

What will be the best score on the InterCode (Bash) benchmark before 2025?

What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?

38.1

Comments

? comments

Authors:

romeodean

Opened:

Closes:

Scheduled resolution:

AI Technical Benchmarks

AI Benchmarks

Artificial Intelligence

Machine learning

Artificial intelligence

Computer science

The Long Road to Genuine AI Mastery

Time•Sep 12, 2024

OpenAI unveils o1, a model that can fact-check itself

TechCrunch•Sep 13, 2024

OpenAI releases o1, its first model with ‘reasoning’ abilities

Verge•Sep 13, 2024

Learn more about Metaculus NewsMatch

What will be the best score on the GAIA benchmark before 2025?

46.4

What will be the best score on the InterCode (Bash) benchmark before 2025?

What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?

38.1