Skip to content
inetGeek

Baseten vs Novita AI

A comparison of Baseten and Novita AI built from values read directly from each provider's own documentation, with the source recorded against every figure.

Updated 11 criteria comparedSources last checked

The short answer

Pick Baseten if
Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.
Pick Novita AI if
Breadth — 200+ models under one API with a cache-read rate published next to most of them, and an H100 SXM at $3.39 an hour if the same vendor should run the dedicated side too.

7 sourced criteria separate them:

Pricing model
Baseten: No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate.
Novita AI: Per-token serverless inference with a cache-read rate published beside most models, and GPU instances offered at both on-demand and spot rates — the spot column is roughly half. Two models, Ling 3.0 Flash Fin and Sante, are listed at no charge on both input and output.
Input price, top model
Baseten: $1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
Novita AI: $2.00 per million input tokens for Qwen3.8 Max, the most expensive model in its catalogue, with cache reads at $0.25 and output at $6.00.
Output price, top model
Baseten: $4.40 per million output tokens for GLM-5.3.
Novita AI: $6.00 per million output tokens for Qwen3.8 Max.
Input price, cheapest model
Baseten: $0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
Novita AI: $0.075 per million input tokens for GLM 5.3 Flash at short context, rising to $0.15 above the threshold, with cache reads at $0.015 and output at $0.25. Fireworks serves the same model at $0.15.
Context window
Baseten: 1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.
Novita AI: 1M tokens on the DeepSeek V4 line and GLM 5.3, published as "1M" rather than an exact figure — so it is recorded at 1,000,000 and may in practice be the 1,048,576 other providers state. Qwen3.8 is listed at 977K.
H100 SXM, per GPU-hour
Baseten: $6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633.
Novita AI: $3.39 per GPU-hour for an on-demand H100 SXM 80GB, or $1.70 spot. The page names the card the site's GPU comparison is fixed on, so no substitution is involved.
Largest GPU offered
Baseten: 180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour.
Novita AI: 80GB per GPU on an H100 SXM, the largest card it lists; below it are an L40S 48GB, RTX 5090 32GB and RTX 4090 24GB.
Visit Baseten documentationVisit Novita AI documentation

No affiliate links, sponsored placements or paid rankings appear on this site. Ordering follows the sourced data and the stated criteria.

01.

At a glance.

CriterionBasetenNovita AI
Pricing
Pricing modelNo platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate.Per-token serverless inference with a cache-read rate published beside most models, and GPU instances offered at both on-demand and spot rates — the spot column is roughly half. Two models, Ling 3.0 Flash Fin and Sante, are listed at no charge on both input and output.
Inference
Input price, top model
$1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
$2.00 per million input tokens for Qwen3.8 Max, the most expensive model in its catalogue, with cache reads at $0.25 and output at $6.00.
Output price, top model
$4.40 per million output tokens for GLM-5.3.
$6.00 per million output tokens for Qwen3.8 Max.
Input price, cheapest model
$0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
$0.075 per million input tokens for GLM 5.3 Flash at short context, rising to $0.15 above the threshold, with cache reads at $0.015 and output at $0.25. Fireworks serves the same model at $0.15.
Context window
1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.
1M tokens on the DeepSeek V4 line and GLM 5.3, published as "1M" rather than an exact figure — so it is recorded at 1,000,000 and may in practice be the 1,048,576 other providers state. Qwen3.8 is listed at 977K.
Prompt cachingSupportedSupported
GPU
H100 SXM, per GPU-hour
$6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633.
$3.39 per GPU-hour for an on-demand H100 SXM 80GB, or $1.70 spot. The page names the card the site's GPU comparison is fixed on, so no substitution is involved.
Largest GPU offered
180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour.
80GB per GPU on an H100 SXM, the largest card it lists; below it are an L40S 48GB, RTX 5090 32GB and RTX 4090 24GB.

Only criteria both providers publish appear here; a tinted cell marks a real difference. Criteria only one of them documents are listed below, and an absence there means we found no source — not that the feature is missing. How we source this.

The small bar above a value is inetGeek's own lean toward that side — computed from the same facts shown, never a number the provider published. See the picker below "The short answer" to weigh only the criteria you care about.

02.

Where they differ.

Pricing model

Baseten
No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate.
Novita AI
Per-token serverless inference with a cache-read rate published beside most models, and GPU instances offered at both on-demand and spot rates — the spot column is roughly half. Two models, Ling 3.0 Flash Fin and Sante, are listed at no charge on both input and output.
Sources (2) →
  • Pricing — Baseten ↗

    “$0 per month, pay as you go [...] Only pay for the compute you use, down to the minute. Volume discounts available [...] Pro Unlimited autoscaling and priority compute access [...] Priority access to high-demand GPUs”

    Read 2026-09-06 · official pricing

  • Pricing — Novita AI ↗

    “Ling 3.0 Flash Fin 256K Free Free [...] Ling 3.0 Flash Sante 256K Free Free [...] On-Demand SPOT”

    Read 2026-09-07 · official pricing

Input price, top model

Baseten
$1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
Novita AI
$2.00 per million input tokens for Qwen3.8 Max, the most expensive model in its catalogue, with cache reads at $0.25 and output at $6.00.
Sources (2) →
  • Pricing — Baseten ↗

    “GLM-5.3 GLM-5.3 $1.40 $1.40 $0.14 $0.14 $4.40 [...] GLM-5.2 Fast GLM-5.2 Fast $2.10 $2.10 $0.21”

    Read 2026-09-06 · official pricing

  • Pricing — Novita AI ↗

    “Qwen3.8 Max 977K $2 /Mt · Cache Read $0.25 /Mt $6 /Mt”

    Read 2026-09-07 · official pricing

Output price, top model

Baseten
$4.40 per million output tokens for GLM-5.3.
Novita AI
$6.00 per million output tokens for Qwen3.8 Max.
Sources (2) →

Input price, cheapest model

Baseten
$0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
Novita AI
$0.075 per million input tokens for GLM 5.3 Flash at short context, rising to $0.15 above the threshold, with cache reads at $0.015 and output at $0.25. Fireworks serves the same model at $0.15.
Sources (2) →
  • Pricing — Baseten ↗

    “GPT OSS 120B GPT OSS 120B $0.10 $0.10 - - $0.50 [...] GLM-5.3-Flash GLM-5.3-Flash $0.15 $0.15 $0.03 $0.03 $0.50”

    Read 2026-09-06 · official pricing

  • Pricing — Novita AI ↗

    “GLM 5.3 Flash 1M $0.075 /Mt · Cache Read $0.015 /Mt $0.15 /Mt · Cache Read $0.03 /Mt $0.25 /Mt $0.5 /Mt”

    Read 2026-09-07 · official pricing

Context window

Baseten

1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.

Novita AI

1M tokens on the DeepSeek V4 line and GLM 5.3, published as "1M" rather than an exact figure — so it is recorded at 1,000,000 and may in practice be the 1,048,576 other providers state. Qwen3.8 is listed at 977K.

Sources (2) →
  • Model APIs overview — Baseten Docs ↗

    “SupportedModelsTable [...] model: "DeepSeek V4 Pro", context: 1048, maxOutput: 262 [...] model: "GLM 5.3", context: 1048, maxOutput: 262 [...] model: "GLM 4.7", context: 200, maxOutput: 200 [...] model: "OpenAI GPT 120B", context: 128, maxOutput: 128”

    Read 2026-09-08 · official docs

  • Pricing — Novita AI ↗

    “DeepSeek V4 Pro 0813 1M [...] GLM 5.3 1M [...] Qwen3.8 Max 977K”

    Read 2026-09-07 · official pricing

H100 SXM, per GPU-hour

Baseten
$6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633.
Novita AI
$3.39 per GPU-hour for an on-demand H100 SXM 80GB, or $1.70 spot. The page names the card the site's GPU comparison is fixed on, so no substitution is involved.
Sources (2) →
  • Pricing — Baseten ↗

    “Dedicated Deployments Only pay for the compute you use, down to the minute. [...] Price per Minute Hour [...] A100 80 GiB VRAM $0.06667 [...] H100 80 GiB VRAM $0.10833 [...] B200 180 GiB VRAM $0.16633”

    Read 2026-09-06 · official pricing

  • GPU Instance — Novita AI ↗

    “On-Demand SPOT H100 SXM 80GB 80 GB VRAM 3.39/hr/GPU 1.70/hr/GPU”

    Read 2026-09-07 · official pricing

Largest GPU offered

Baseten

180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour.

Novita AI

80GB per GPU on an H100 SXM, the largest card it lists; below it are an L40S 48GB, RTX 5090 32GB and RTX 4090 24GB.

Sources (2) →

When these numbers change, hear about it. Sources are re-checked monthly; a repricing goes out as a short note.

Confirm by email; unsubscribe from any issue. Your address goes to Kit and nowhere else — what we do with it.

03.

Which should you choose?

Choose Baseten if…

Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.

Editorial · Palash Bagchi · approved

Choose Novita AI if…

Breadth — 200+ models under one API with a cache-read rate published next to most of them, and an H100 SXM at $3.39 an hour if the same vendor should run the dedicated side too.

Editorial · Palash Bagchi · approved

Consider something else if…

  • Baseten: Its dedicated H100 works out at $6.50 an hour, roughly three times DeepInfra's, so steady GPU workloads pay a premium for the platform around them.
  • Novita AI: It is rarely the cheapest for any given model: DeepInfra serves DeepSeek-V4-Flash-0731 at $0.06 against Novita's $0.44, and its H100 is $2.20 against Novita's $3.39 on demand.
04.

Documented by only one.

These criteria are published by one provider and not the other. An absence here means we have not found a source, not that the feature is missing.

Entry paid planBaseten: $0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee.
Max output tokensBaseten: 262K tokens on most models, and it is a separate ceiling from the context window rather than the remainder of it: DeepSeek V4 Flash 0731 allows 384K output inside a 1,048K window, while GLM 4.7, Nemotron Ultra and GPT OSS 120B cap output at their full context. The Inkling models are the outlier at 32K.
Rate limitsBaseten: Two limits, requests and tokens per minute, set by account status rather than spend: an unverified Basic account gets 15 RPM and 100,000 TPM, a verified Basic or Pro account 120 RPM and 500,000 TPM, Enterprise custom. Cached input counts toward TPM at full weight even though it is billed cheaper.
05.

Questions this comparison answers.

Should I choose Baseten or Novita AI?

Pick Baseten if Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.

Pick Novita AI if Breadth — 200+ models under one API with a cache-read rate published next to most of them, and an H100 SXM at $3.39 an hour if the same vendor should run the dedicated side too.

Provider pages

BasetenModel inference platform with per-token APIs for open models and dedicated deployments billed by the minute.Novita AIServerless inference across 200+ open models with per-model cache-read rates, plus on-demand and spot GPU instances.

Related comparisons

Baseten vs AnthropicBaseten vs Fireworks AIDeepInfra vs BasetenDeepInfra vs Novita AIDeepSeek vs Novita AIFireworks AI vs Novita AIAnthropic vs DeepSeekAnthropic vs Fireworks AI

Every page here is sourced and dated.