Question

Will transformer derived architectures still be state of the art for language modeling in December 2025?

8 comments8

Total Forecasters61

Community Prediction85%

Make a Prediction

50%

community: 85%

median 85.0%mean 84.0%

Authors:

Matthew_Barnett

Opened:

Closes:

Scheduled resolution:

AI Training and Compute

AI Technical Benchmarks

Artificial Intelligence

Neuroscience

Rnn (software)

Long short-term memory

Artificial intelligence

Will transformer models be the state-of-the-art on most natural language processing benchmarks on January 1, 2027?

72%

Will transformer derived architectures accelerate progress in deep learning?

32%

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

65%

Comments

? comments

Authors:

Matthew_Barnett

Opened:

Closes:

Scheduled resolution:

AI Training and Compute

AI Technical Benchmarks

Artificial Intelligence

Neuroscience

Rnn (software)

Long short-term memory

Artificial intelligence

The Long Road to Genuine AI Mastery

Time•Sep 12, 2024

Do Large Language Models Have a Subconscious?

Psychology Today•Sep 12, 2024

The Evolution of LLMs Through Real-Time Learning

Psychology Today•Sep 13, 2024

Learn more about Metaculus NewsMatch

Will transformer models be the state-of-the-art on most natural language processing benchmarks on January 1, 2027?

72%

Will transformer derived architectures accelerate progress in deep learning?

32%

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

65%