Last verified

Models AI glossary

What is a reasoning model?

A reasoning model is a language model trained to work through a problem in hidden reasoning tokens before writing its answer, trading extra output tokens and latency for better results on multi-step tasks.

At a glance

  • How it works: Before answering, the model drafts, checks and revises in a stream of reasoning tokens you mostly do not see; the answer draws on that work.
  • Why it matters: It is markedly better at maths, code, analysis and long agent tasks — and slower and dearer on everything, including questions that did not need it.
  • What it costs: Its thinking bills at the output rate — $10 per million on GPT-6 Sol — on top of the visible answer.
  • Related to: Reasoning tokens, reasoning effort, LLM, max output tokens.

What makes a model a reasoning model

A standard model answers in a single pass: whatever working it needs has to happen implicitly as it writes. A reasoning model is trained to think first. Anthropic describes the behaviour concretely: the model restates what is being asked, tries approaches, checks intermediate results and abandons paths that do not hold up, and only then writes the response. OpenAI describes its reasoning models as breaking down the prompt and considering multiple approaches in internal reasoning tokens.

The thinking is mostly hidden. OpenAI does not expose raw reasoning and offers an optional summary; Anthropic returns a summary or nothing; Google returns optional thought summaries. In every case you are billed for the full thinking, not the summary.

What reasoning costs

Reasoning is billed as output, at the output rate, by OpenAI, Anthropic and Google. OpenAI notes that its models may generate anywhere from a few hundred to tens of thousands of reasoning tokens per response, depending on the problem — so the cost of a request is no longer predictable from the length of the answer you read. It is also slower: the user waits while the thinking is generated.

Many current flagship models reason by default. Anthropic's newest Claude models have thinking on with no configuration, and some of them do not allow it to be switched off entirely; OpenAI lets you turn effort down, but not to zero everywhere: GPT-6 Astra rejects none, and GPT-6.1 Sol rejects both none and minimal. Treat reasoning as the default cost of a modern frontier model, and budget for it.

Worked exampleA coding question with and without deep thinking

5,000 requests a month on GPT-6 Sol, priced at its current list rates, checked on 2026-09-30.

Light thinking · 1,500 tokens
Input · 30M tokens @ $2.00/M$60.00
Output · 4M tokens @ $10.00/M$40.00
Reasoning, billed as output · 7.5M tokens @ $10.00/M$75.00
Blended · per 1M tokens billed$4.22
Per request$0.035
Per month$175
Deep thinking · 15,000 tokens +386%
Input · 30M tokens @ $2.00/M$60.00
Output · 4M tokens @ $10.00/M$40.00
Reasoning, billed as output · 75M tokens @ $10.00/M$750
Blended · per 1M tokens billed$7.80
Per request$0.170
Per month$850

The reasoning volumes are illustrations within the range OpenAI documents. The question and the visible answer are the same size in both columns; the difference is thinking billed at the output rate.

Change the workload or the model in the LLM API cost calculator.

Controlling it

Vendors expose a soft dial and a hard limit. The dial is reasoning effort — OpenAI's reasoning.effort, Anthropic's effort, Google's thinking_level — which shifts how much the model thinks on average. The limit is the output-token cap, which covers reasoning and answer together. Anthropic recommends lowering effort first to cut the cost of a thinking workload, and using max_tokens when you need a strict ceiling.

When a reasoning model is worth it

Use one where an extra minute of thought changes the answer: debugging, refactoring across files, maths, planning a multi-step task, reviewing a contract clause against several rules. Skip it — or run it at low effort — for extraction, classification, short rewrites and chat replies, where it adds cost and latency without a better result. Routing requests by difficulty lets one product use both.

Frequently asked.

Short answers to the questions that come up next.

Q · 01 Why is a reasoning model more expensive? +
Not because of a higher rate — reasoning bills at the normal output rate — but because the model generates many hidden reasoning tokens before its answer, and you pay for all of them.
Q · 02 Can I see a reasoning model's thinking? +
Only a summary, if the vendor offers one. OpenAI, Anthropic and Google do not return the raw chain of thought, and all bill the full thinking regardless.
Q · 03 Can I turn reasoning off? +
On some models. OpenAI accepts none on some GPT models, but GPT-6 Astra rejects it and GPT-6.1 Sol rejects both none and minimal; some of Anthropic's newest models keep thinking on and offer lower effort instead. Check the model's documentation.

Sources · read on the date shown