Last verified

Models AI glossary

What is reasoning effort?

Reasoning effort is a request setting on reasoning models that tells the model how much to think before answering, trading answer quality on hard tasks against output tokens, cost and latency.

At a glance

  • How it works: You pick a level — low, medium, high and so on — and the model scales how often and how deeply it reasons; the exact token count still varies per request.
  • Why it matters: It is usually the largest single lever on a reasoning model's bill, and the one teams most often leave at the default.
  • What it costs: Each step up generates more hidden reasoning, billed at the model's output rate — GPT-6 Sol's is $10 per million.
  • Related to: Reasoning tokens, reasoning model, max output tokens, prompt caching.

How the effort setting works

Effort is guidance, not a budget. OpenAI describes reasoning.effort as guiding the model on how much to think: lower effort favours speed and fewer tokens, higher effort lets the model think more completely. Anthropic's effort controls how much work Claude puts into the whole response — in adaptive thinking mode, including how often and how deeply it thinks. Google's thinking_level does the same for Gemini.

The levels differ by vendor and by model. OpenAI lists none, minimal, low, medium, high, xhigh and max as possible values, while noting that support is model-dependent: GPT-6 Astra rejects none, and GPT-6.1 Sol accepts neither none nor minimal and defaults to medium. Anthropic's levels run from low to max, and on some of its newest models certain thinking settings are accepted only at high effort or below.

What each step up costs

Effort changes the number of reasoning tokens, and those are billed as output. Because the count is decided by the model per request, no vendor publishes a fixed token figure per level — OpenAI only describes a range from a few hundred to tens of thousands of reasoning tokens per response. The practical way to price a level is to run a sample of your own requests at each setting and read the output tokens from the usage report.

Changing effort can also cost you cache hits. Anthropic renders the thinking configuration and the effort level into the prompt itself, so switching levels starts a new cache prefix. OpenAI's GPT-6 models offer a configuration update that changes effort mid-conversation while keeping the original prompt prefix intact for caching.

Worked exampleOne request at three effort levels

20,000 requests a month on GPT-6 Sol, priced at its current list rates, checked on 2026-09-30.

Low · 800 reasoning tokens
Input · 60M tokens @ $2.00/M$120
Output · 14M tokens @ $10.00/M$140
Reasoning, billed as output · 16M tokens @ $10.00/M$160
Blended · per 1M tokens billed$4.67
Per request$0.021
Per month$420
Medium · 4,000 +152%
Input · 60M tokens @ $2.00/M$120
Output · 14M tokens @ $10.00/M$140
Reasoning, billed as output · 80M tokens @ $10.00/M$800
Blended · per 1M tokens billed$6.88
Per request$0.053
Per month$1,060
High · 12,000 +533%
Input · 60M tokens @ $2.00/M$120
Output · 14M tokens @ $10.00/M$140
Reasoning, billed as output · 240M tokens @ $10.00/M$2,400
Blended · per 1M tokens billed$8.47
Per request$0.133
Per month$2,660

The reasoning counts per level are assumptions for illustration — vendors do not publish fixed figures, and the real count varies per request. Measure your own at each level before choosing.

Change the workload or the model in the LLM API cost calculator.

Choosing a level

Start at the vendor's default and move down until quality drops on your own evaluation set; then go back one step. OpenAI suggests trying low before none for latency-sensitive work, and reserving xhigh for deep research and long agentic runs where evaluations show a clear benefit. Anthropic's guidance for a thinking workload that costs too much is to lower effort first.

Effort is soft, so pair it with a hard limit. A sensible output cap stops a rare runaway response; effort shapes the average. Different steps of one product can use different levels — a quick reply at low effort, a planning step at high — which is a form of routing within one model.

Frequently asked.

Short answers to the questions that come up next.

Q · 01 Does lower reasoning effort reduce cost? +
Usually, because the model generates fewer reasoning tokens on average and those bill as output. The saving varies per request, so measure it on your own traffic.
Q · 02 Is reasoning effort the same as a token budget? +
No. Effort is soft guidance; Anthropic describes max_tokens as the strict limit. Use effort to shape the average and the output cap as a ceiling.
Q · 03 What reasoning effort levels does OpenAI support? +
Model-dependent values among none, minimal, low, medium, high, xhigh and max. GPT-6 Astra does not accept none; GPT-6.1 Sol accepts neither none nor minimal.
Q · 04 Does changing effort break prompt caching? +
At Anthropic it starts a new cache prefix, because the effort level is rendered into the prompt. OpenAI's GPT-6 models can change effort through a configuration update that preserves the cached prefix.

Sources · read on the date shown