Baseten
Model inference platform with per-token APIs for open models and dedicated deployments billed by the minute.
- LLM APIs
- Not documented
- $0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee.
- Not documented
Who it suits.
Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.
Consider something else if…
Its dedicated H100 works out at $6.50 an hour, roughly three times DeepInfra's, so steady GPU workloads pay a premium for the platform around them.
Editorial · Palash Bagchi · approved
What the documentation says.
Each value below links to the page it was read from, with the sentence it came from. Criteria Baseten does not publish are not listed.
Pricing
Entry paid plan
$0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee.
Sources (1) →Sources ↓
- Pricing — Baseten ↗
“Baseten $0 per month, pay as you go Get started [...] Included in Basic: Dedicated deployments Model APIs Training Fast cold starts SOC 2 Type II and HIPAA compliant”
Read 2026-09-06 · official pricing
Pricing model
No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate.
Sources (1) →Sources ↓
- Pricing — Baseten ↗
“$0 per month, pay as you go [...] Only pay for the compute you use, down to the minute. Volume discounts available [...] Pro Unlimited autoscaling and priority compute access [...] Priority access to high-demand GPUs”
Read 2026-09-06 · official pricing
Inference
Input price, top model
$1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
Sources (1) →Sources ↓
- Pricing — Baseten ↗
“GLM-5.3 GLM-5.3 $1.40 $1.40 $0.14 $0.14 $4.40 [...] GLM-5.2 Fast GLM-5.2 Fast $2.10 $2.10 $0.21”
Read 2026-09-06 · official pricing
Output price, top model
$4.40 per million output tokens for GLM-5.3.
Sources (1) →Sources ↓
- Pricing — Baseten ↗
“GLM-5.3 GLM-5.3 $1.40 $1.40 $0.14 $0.14 $4.40”
Read 2026-09-06 · official pricing
Input price, cheapest model
$0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
Sources (1) →Sources ↓
- Pricing — Baseten ↗
“GPT OSS 120B GPT OSS 120B $0.10 $0.10 - - $0.50 [...] GLM-5.3-Flash GLM-5.3-Flash $0.15 $0.15 $0.03 $0.03 $0.50”
Read 2026-09-06 · official pricing
Context window
1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.
Sources (1) →Sources ↓
- Model APIs overview — Baseten Docs ↗
“SupportedModelsTable [...] model: "DeepSeek V4 Pro", context: 1048, maxOutput: 262 [...] model: "GLM 5.3", context: 1048, maxOutput: 262 [...] model: "GLM 4.7", context: 200, maxOutput: 200 [...] model: "OpenAI GPT 120B", context: 128, maxOutput: 128”
Read 2026-09-08 · official docs
Max output tokens
262K tokens on most models, and it is a separate ceiling from the context window rather than the remainder of it: DeepSeek V4 Flash 0731 allows 384K output inside a 1,048K window, while GLM 4.7, Nemotron Ultra and GPT OSS 120B cap output at their full context. The Inkling models are the outlier at 32K.
Sources (1) →Sources ↓
- Model APIs overview — Baseten Docs ↗
“SupportedModelsTable [...] model: "DeepSeek V4 Pro", context: 1048, maxOutput: 262 [...] model: "GLM 5.3", context: 1048, maxOutput: 262 [...] model: "GLM 4.7", context: 200, maxOutput: 200 [...] model: "OpenAI GPT 120B", context: 128, maxOutput: 128”
Read 2026-09-08 · official docs
Prompt caching
Supported
Sources (1) →Sources ↓
- Pricing — Baseten ↗
“GLM-5.3 $1.40 $1.40 $0.14 $0.14 $4.40 [...] GLM-5.3-Flash $0.15 $0.15 $0.03 $0.03 $0.50”
Read 2026-09-06 · official pricing
Rate limits
Two limits, requests and tokens per minute, set by account status rather than spend: an unverified Basic account gets 15 RPM and 100,000 TPM, a verified Basic or Pro account 120 RPM and 500,000 TPM, Enterprise custom. Cached input counts toward TPM at full weight even though it is billed cheaper.
Sources (1) →Sources ↓
- Pricing and limits — Baseten Docs ↗
“Basic (unverified) | 15 | 100,000 | Basic (verified) | 120 | 500,000 | Pro | 120 | 500,000 [...] Cached and uncached input tokens count equally toward this limit, even though cached tokens cost less.”
Read 2026-09-07 · official docs
GPU
H100 SXM, per GPU-hour
$6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633.
Sources (1) →Sources ↓
- Pricing — Baseten ↗
“Dedicated Deployments Only pay for the compute you use, down to the minute. [...] Price per Minute Hour [...] A100 80 GiB VRAM $0.06667 [...] H100 80 GiB VRAM $0.10833 [...] B200 180 GiB VRAM $0.16633”
Read 2026-09-06 · official pricing
Largest GPU offered
180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour.
Sources (1) →Sources ↓
- Pricing — Baseten ↗
“B200 180 GiB VRAM $0.16633 Deploy”
Read 2026-09-06 · official pricing
When these numbers change, hear about it. Sources are re-checked monthly; a repricing goes out as a short note.
Baseten in the news
- Baseten Stock: Infer Before You Invest - Access IPOs
- Baseten Reportedly Raises $1.5B To Scale AI Inference Infrastructure - Yellow.com
- Baseten built the fastest GLM-5.2 API on earth and the playbook tells you where inference is heading - startupfortune.com
- Baseten Secures $1.5 Billion Series F to Expand AI Inference Fleet - theaisoftwarereport.com