Skip to content
inetGeek

DeepInfra vs Baseten

A comparison of DeepInfra and Baseten built from values read directly from each provider's own documentation, with the source recorded against every figure.

Updated 11 criteria comparedSources last checked

The short answer

Pick DeepInfra if
Running open-weight models at the lowest published per-token rates here — DeepSeek-V4-Flash at $0.06 per million input is a fraction of what the lab itself charges — with dedicated H100s at $2.20 an hour if throughput demands it.
Pick Baseten if
Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.

7 sourced criteria separate them:

Pricing model
DeepInfra: Two products on one bill: per-token serverless inference with a separate cached-input rate for each model, and dedicated GPUs billed per minute and invoiced weekly. Models without per-token pricing are billed for inference execution time instead.
Baseten: No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate.
Input price, top model
DeepInfra: $1.30 per million input tokens for DeepSeek-V4-Pro, the most expensive model in its catalogue. Cached input is $0.10.
Baseten: $1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
Output price, top model
DeepInfra: $2.60 per million output tokens for DeepSeek-V4-Pro.
Baseten: $4.40 per million output tokens for GLM-5.3.
Input price, cheapest model
DeepInfra: $0.06 per million input tokens for DeepSeek-V4-Flash-0731, with cached input at $0.015 and output at $0.18. DeepSeek itself charges $0.44 at peak for the same checkpoint and Fireworks $0.22.
Baseten: $0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
Context window
DeepInfra: 1024k tokens on the DeepSeek V4 models it serves; 160k on the V3 generation. The window is the model's rather than a platform limit.
Baseten: 1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.
H100 SXM, per GPU-hour
DeepInfra: $2.20 per GPU-hour for a dedicated H100 80GB — below every dedicated cloud in this dataset. A100 80GB is $0.89, H200 $2.69, B200 $3.69. Billed in minute granularity, invoiced weekly.
Baseten: $6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633.
Largest GPU offered
DeepInfra: 270GB per GPU on a B300, at $4.89 per GPU-hour.
Baseten: 180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour.
Visit DeepInfra documentationVisit Baseten documentation

No affiliate links, sponsored placements or paid rankings appear on this site. Ordering follows the sourced data and the stated criteria.

01.

At a glance.

CriterionDeepInfraBaseten
Pricing
Pricing modelTwo products on one bill: per-token serverless inference with a separate cached-input rate for each model, and dedicated GPUs billed per minute and invoiced weekly. Models without per-token pricing are billed for inference execution time instead.No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate.
Inference
Input price, top model
$1.30 per million input tokens for DeepSeek-V4-Pro, the most expensive model in its catalogue. Cached input is $0.10.
$1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
Output price, top model
$2.60 per million output tokens for DeepSeek-V4-Pro.
$4.40 per million output tokens for GLM-5.3.
Input price, cheapest model
$0.06 per million input tokens for DeepSeek-V4-Flash-0731, with cached input at $0.015 and output at $0.18. DeepSeek itself charges $0.44 at peak for the same checkpoint and Fireworks $0.22.
$0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
Context window
1024k tokens on the DeepSeek V4 models it serves; 160k on the V3 generation. The window is the model's rather than a platform limit.
1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.
Prompt cachingSupportedSupported
GPU
H100 SXM, per GPU-hour
$2.20 per GPU-hour for a dedicated H100 80GB — below every dedicated cloud in this dataset. A100 80GB is $0.89, H200 $2.69, B200 $3.69. Billed in minute granularity, invoiced weekly.
$6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633.
Largest GPU offered
270GB per GPU on a B300, at $4.89 per GPU-hour.
180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour.

Only criteria both providers publish appear here; a tinted cell marks a real difference. Criteria only one of them documents are listed below, and an absence there means we found no source — not that the feature is missing. How we source this.

The small bar above a value is inetGeek's own lean toward that side — computed from the same facts shown, never a number the provider published. See the picker below "The short answer" to weigh only the criteria you care about.

02.

Where they differ.

Pricing model

DeepInfra
Two products on one bill: per-token serverless inference with a separate cached-input rate for each model, and dedicated GPUs billed per minute and invoiced weekly. Models without per-token pricing are billed for inference execution time instead.
Baseten
No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate.
Sources (2) →
  • Pricing — DeepInfra ↗

    “Some of our langauge models offer per token pricing. Most other models are billed for inference execution time. [...] Billed in minute granularity Invoiced weekly”

    Read 2026-09-06 · official pricing

  • Pricing — Baseten ↗

    “$0 per month, pay as you go [...] Only pay for the compute you use, down to the minute. Volume discounts available [...] Pro Unlimited autoscaling and priority compute access [...] Priority access to high-demand GPUs”

    Read 2026-09-06 · official pricing

Input price, top model

DeepInfra
$1.30 per million input tokens for DeepSeek-V4-Pro, the most expensive model in its catalogue. Cached input is $0.10.
Baseten
$1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
Sources (2) →
  • Pricing — DeepInfra ↗

    “DeepSeek-V4-Pro 1024k $1.30 / $0.10 cached $2.60”

    Read 2026-09-06 · official pricing

  • Pricing — Baseten ↗

    “GLM-5.3 GLM-5.3 $1.40 $1.40 $0.14 $0.14 $4.40 [...] GLM-5.2 Fast GLM-5.2 Fast $2.10 $2.10 $0.21”

    Read 2026-09-06 · official pricing

Output price, top model

DeepInfra
$2.60 per million output tokens for DeepSeek-V4-Pro.
Baseten
$4.40 per million output tokens for GLM-5.3.
Sources (2) →

Input price, cheapest model

DeepInfra
$0.06 per million input tokens for DeepSeek-V4-Flash-0731, with cached input at $0.015 and output at $0.18. DeepSeek itself charges $0.44 at peak for the same checkpoint and Fireworks $0.22.
Baseten
$0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
Sources (2) →
  • Pricing — DeepInfra ↗

    “DeepSeek-V4-Flash-0731 1024k $0.06 / $0.015 cached $0.18”

    Read 2026-09-06 · official pricing

  • Pricing — Baseten ↗

    “GPT OSS 120B GPT OSS 120B $0.10 $0.10 - - $0.50 [...] GLM-5.3-Flash GLM-5.3-Flash $0.15 $0.15 $0.03 $0.03 $0.50”

    Read 2026-09-06 · official pricing

Context window

DeepInfra

1024k tokens on the DeepSeek V4 models it serves; 160k on the V3 generation. The window is the model's rather than a platform limit.

Baseten

1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.

Sources (2) →
  • Pricing — DeepInfra ↗

    “DeepSeek-V4-Pro 1024k [...] DeepSeek-V3.2 160k $0.26 / $0.13 cached $0.38”

    Read 2026-09-06 · official pricing

  • Model APIs overview — Baseten Docs ↗

    “SupportedModelsTable [...] model: "DeepSeek V4 Pro", context: 1048, maxOutput: 262 [...] model: "GLM 5.3", context: 1048, maxOutput: 262 [...] model: "GLM 4.7", context: 200, maxOutput: 200 [...] model: "OpenAI GPT 120B", context: 128, maxOutput: 128”

    Read 2026-09-08 · official docs

H100 SXM, per GPU-hour

DeepInfra
$2.20 per GPU-hour for a dedicated H100 80GB — below every dedicated cloud in this dataset. A100 80GB is $0.89, H200 $2.69, B200 $3.69. Billed in minute granularity, invoiced weekly.
Baseten
$6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633.
Sources (2) →
  • Pricing — DeepInfra ↗

    “A100 80GB $0.89 / GPU-hour H100 80GB $2.20 / GPU-hour H200 141GB $2.69 / GPU-hour B200 180GB $3.69 / GPU-hour B300 270GB $4.89 / GPU-hour [...] Billed in minute granularity Invoiced weekly”

    Read 2026-09-06 · official pricing

  • Pricing — Baseten ↗

    “Dedicated Deployments Only pay for the compute you use, down to the minute. [...] Price per Minute Hour [...] A100 80 GiB VRAM $0.06667 [...] H100 80 GiB VRAM $0.10833 [...] B200 180 GiB VRAM $0.16633”

    Read 2026-09-06 · official pricing

Largest GPU offered

DeepInfra

270GB per GPU on a B300, at $4.89 per GPU-hour.

Baseten

180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour.

Sources (2) →

When these numbers change, hear about it. Sources are re-checked monthly; a repricing goes out as a short note.

Confirm by email; unsubscribe from any issue. Your address goes to Kit and nowhere else — what we do with it.

03.

Which should you choose?

Choose DeepInfra if…

Running open-weight models at the lowest published per-token rates here — DeepSeek-V4-Flash at $0.06 per million input is a fraction of what the lab itself charges — with dedicated H100s at $2.20 an hour if throughput demands it.

Editorial · Palash Bagchi · approved

Choose Baseten if…

Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.

Editorial · Palash Bagchi · approved

Consider something else if…

  • DeepInfra: Only some models carry per-token pricing; the rest bill for inference execution time, which is a different and harder thing to forecast.
  • Baseten: Its dedicated H100 works out at $6.50 an hour, roughly three times DeepInfra's, so steady GPU workloads pay a premium for the platform around them.
04.

Documented by only one.

These criteria are published by one provider and not the other. An absence here means we have not found a source, not that the feature is missing.

Entry paid planBaseten: $0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee.
Max output tokensBaseten: 262K tokens on most models, and it is a separate ceiling from the context window rather than the remainder of it: DeepSeek V4 Flash 0731 allows 384K output inside a 1,048K window, while GLM 4.7, Nemotron Ultra and GPT OSS 120B cap output at their full context. The Inkling models are the outlier at 32K.
Rate limitsBaseten: Two limits, requests and tokens per minute, set by account status rather than spend: an unverified Basic account gets 15 RPM and 100,000 TPM, a verified Basic or Pro account 120 RPM and 500,000 TPM, Enterprise custom. Cached input counts toward TPM at full weight even though it is billed cheaper.
05.

Questions this comparison answers.

Should I choose DeepInfra or Baseten?

Pick DeepInfra if Running open-weight models at the lowest published per-token rates here — DeepSeek-V4-Flash at $0.06 per million input is a fraction of what the lab itself charges — with dedicated H100s at $2.20 an hour if throughput demands it.

Pick Baseten if Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.

Provider pages

DeepInfraServerless inference for open-weight models with published cached-input rates, plus dedicated GPUs billed by the minute.BasetenModel inference platform with per-token APIs for open models and dedicated deployments billed by the minute.

Related comparisons

Baseten vs AnthropicBaseten vs Fireworks AIBaseten vs Novita AIDeepInfra vs DeepSeekDeepInfra vs Fireworks AIDeepInfra vs Novita AIDeepInfra vs OpenAIAnthropic vs DeepSeek

Every page here is sourced and dated.