Last verified
AI researchVendor-reportedPrices verified

MLE-bench leaderboard

As of November 8, 2026, Gemini 3.6 Flash (Google) leads MLE-bench at 63.9%, ahead of Gemini 3.5 Flash at 49.7% and Gemini 3.1 Pro Preview at 42.6%. 5 systems ranked. Every score here is published by the model's own lab; each row links to the page it comes from.

Top score
63.9%
Gemini 3.6 Flash
Systems ranked
5
one setting
Independent rows
0/5
all vendor-reported
Cheapest near top
$0.481/1M
Gemini 3.6 Flash · within 5 pts
With API prices
5/5
rates from our price index
Newest score
Jul 21
2026 · newest result

What is MLE-bench? MLE-bench tests whether an AI agent can do machine-learning engineering end to end on 75 real Kaggle competitions: prepare data, train models and submit. Made by OpenAI, October 2024.

§ 01 / LEADERBOARD

Top models on MLE-bench, November 2026

5 entries
# Model Score Price / 1M Context Source
1 Gemini 3.6 Flash Google
63.9%
as reported
$0.75 / $3.75 1M Vendor-reported Google DeepMind
2 Gemini 3.5 Flash Deprecated Google
49.7%
as reported
$1.5 / $9 1M Vendor-reported Google DeepMind
3 Gemini 3.1 Pro Preview Preview Google · listed as “Gemini 3.1 Pro”
42.6%
as reported
$2 / $12 1M Vendor-reported Google DeepMind
4 Gemini 3.5 Flash-Lite Google
39.2%
as reported
$0.3 / $2.5 1M Vendor-reported Google DeepMind
5 Gemini 3.1 Flash-Lite Deprecated Google
22%
as reported
$0.25 / $1.5 1M Vendor-reported Google DeepMind
§ 02 / PROVENANCE

Can you trust MLE-bench scores?

No independent leaderboard publishes MLE-bench results for these models yet, so every number on this page is the lab's own report of its own model. Labs choose the harness, the effort level and the subset they report, and they rarely publish failures. Read the setting under each score before comparing two rows.

§ 03 / HOW IT WORKS

How MLE-bench works

The task

For each competition the agent gets the description and data in a container and has up to 24 hours to train, experiment and produce a submission file.

The score

The headline is the share of attempts that would earn a Kaggle medal, judged against each competition's private leaderboard.

Test set

75 Kaggle competitions, as published by the authors.

Made by

OpenAI, first published October 2024.

Official sources

§ 04 / SOURCES

Sources and freshness

5 published scores from 2 sources. Each was read on its source page; the oldest reading on this page is from November 8, 2026. Prices beside each score come from our model price index and move when a vendor reprices.

MLE-bench FAQ

Answers derived from the 5 published scores on this page and the current price index.

Q · 01

Which AI model has the highest MLE-bench score?

+
Gemini 3.6 Flash with 63.9% (as reported), as reported by Google DeepMind on July 21, 2026. Next: Gemini 3.5 Flash at 49.7% and Gemini 3.1 Pro Preview at 42.6%.
Q · 02

What is the cheapest model near the top of MLE-bench?

+
The leader itself. No priced model within 5 points of Gemini 3.6 Flash is cheaper: it runs at $0.481 per 1M tokens on our effective blend ($0.75 input, $3.75 output).
Q · 03

Are these MLE-bench scores independently verified?

+
Not yet. Every score here is the model maker's own report. Each row names the lab and links to the page where it published the number.
Q · 04

What does MLE-bench measure?

+
MLE-bench tests whether an AI agent can do machine-learning engineering end to end on 75 real Kaggle competitions: prepare data, train models and submit. For each competition the agent gets the description and data in a container and has up to 24 hours to train, experiment and produce a submission file.
Q · 05

How is the MLE-bench score calculated?

+
The headline is the share of attempts that would earn a Kaggle medal, judged against each competition's private leaderboard. The test set has 75 Kaggle competitions.
Q · 06

How current is this MLE-bench leaderboard?

+
The newest score was published on July 21, 2026. Every row shows the date its source published it, and we last read all of them on November 8, 2026. Prices come from our model price index, where each rate carries the date it was read on the vendor's page.

One weekly digest. Zero noise.

One weekly digest · No spam, ever · Unsubscribe in one click