Skip to content
inetGeek

Baseten vs Novita AI

SEPT 2026 audit

A comparison of Baseten and Novita AI built from values read directly from each provider's own documentation, with the source recorded against every figure.

Reviewed by Palash BagchiUpdated 27 criteria comparedSources last checked

The short answer

Choose Baseten if…

Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.

Editorial · Palash Bagchi · approved

Choose Novita AI if…

Breadth — 200+ models under one API with a cache-read rate published next to most of them, and an H100 SXM at $3.39 an hour if the same vendor should run the dedicated side too.

Editorial · Palash Bagchi · approved

Consider something else if…

  • Baseten: Its dedicated H100 works out at $6.50 an hour, roughly three times DeepInfra's, so steady GPU workloads pay a premium for the platform around them.
  • Novita AI: It is rarely the cheapest for any given model: DeepInfra serves DeepSeek-V4-Flash-0731 at $0.06 against Novita's $0.44, and its H100 is $2.20 against Novita's $3.39 on demand.

20 sourced criteria separate them — see where, with sources, below.

No affiliate links, sponsored placements or paid rankings appear on this site. Ordering follows the sourced data and the stated criteria.

01.

At a glance.

CriterionBasetenNovita AI
Pricing
Free tier
No — New workspaces get starting credits for testing; usage beyond them is billed per minute.
Yes — Three inclusionAI Ling 3.0 Flash variants are listed at $0 input and $0 output; all other models are paid per token.
Kind of free offerFree creditFree tier
Entry paid plan$0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee.No plan fee — credit is prepaid, and a manual top-up must be greater than $10.
Pricing modelNo platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate.Per-token serverless inference with a cache-read rate published beside most models, and GPU instances offered at both on-demand and spot rates — the spot column is roughly half. Two models, Ling 3.0 Flash Fin and Sante, are listed at no charge on both input and output.
Infrastructure
RegionsTwo Baseten regions selectable for regional deployments: us (United States) and eu (European Union); other regions by request to support. GPU model deployments only; Chains, training jobs and shared CPU types cannot select a region.GPU cloud page advertises 14 global regions in its feature list and, lower on the same page, 20+ locations across 4+ continents.
Inference
Input price, top model
$1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
$2.00 per million input tokens for Qwen3.8 Max, the most expensive model in its catalogue, with cache reads at $0.25 and output at $6.00.
Output price, top model
$4.40 per million output tokens for GLM-5.3.
$6.00 per million output tokens for Qwen3.8 Max.
Input price, cheapest model
$0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
$0.075 per million input tokens for GLM 5.3 Flash at short context, rising to $0.15 above the threshold, with cache reads at $0.015 and output at $0.25. Fireworks serves the same model at $0.15.
Context window
1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.
1M tokens on the DeepSeek V4 line and GLM 5.3, published as "1M" rather than an exact figure — so it is recorded at 1,000,000 and may in practice be the 1,048,576 other providers state. Qwen3.8 is listed at 977K.
Max output tokens262K tokens on most models, and it is a separate ceiling from the context window rather than the remainder of it: DeepSeek V4 Flash 0731 allows 384K output inside a 1,048K window, while GLM 4.7, Nemotron Ultra and GPT OSS 120B cap output at their full context. The Inkling models are the outlier at 32K.128K (131,072) maximum output tokens for Qwen3.8 Max, the highest-priced model in the catalogue, against a 977K context.
Prompt cachingSupportedSupported
Rate limitsTwo limits, requests and tokens per minute, set by account status rather than spend: an unverified Basic account gets 15 RPM and 100,000 TPM, a verified Basic or Pro account 120 RPM and 500,000 TPM, Enterprise custom. Cached input counts toward TPM at full weight even though it is billed cheaper.Per-model RPM and TPM ceilings set by account tier T1–T5, where tier follows monthly top-ups: T1 up to $50 a month, T5 at least $10,000 in one of the last three months.
GPU
H100 SXM, per GPU-hour$6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633.$3.39 per GPU-hour for an on-demand H100 SXM 80GB, or $1.70 spot.
Largest GPU offered
180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour.
80GB per GPU on an H100 SXM, the largest card it lists; below it are an L40S 48GB, RTX 5090 32GB and RTX 4090 24GB.
Compliance
SOC 2Maintains SOC 2 Type II certification for the inference platform; policies and certifications are held in the Baseten Trust Center.SOC 2 Type II; the audit report is available under NDA to enterprise customers on request through the Trust Center.
HIPAA
Maintains HIPAA compliance alongside SOC 2 Type II for model inference on the Baseten platform.
Not by default configured to comply with HIPAA, FISMA or GLBA; the Terms of Service direct affected users to contact support for enterprise arrangements. Terms of Use section 1, page updated August 5, 2026.
GDPR / data residency
Baseten Cloud supports a GDPR compliance program; residency is set with regional environments or a region on a single deployment.
GDPR compliance claimed; EU/EEA transfers rely on Standard Contractual Clauses (Module 2), UK transfers on the IDTA or UK Addendum.
Encryption at restTrust Center control: datastores housing sensitive customer data are encrypted at rest, and transmission over public networks is encrypted.AES-256 for data at rest; TLS 1.2+ in transit between customers, Novita and its service providers.
Role-based access controlRole-based access control with three organization roles - Admin, Member and Viewer - in a single-team organization.Team accounts define five roles — Owner, Admin, Developer, Basic and Billing — each with read/write or view-only rights over all or only self-created resources.
Private networking / VPCSingle-tenant Enterprise environments expose endpoints via AWS PrivateLink or Google Cloud Private Service Connect, off the public internet.Per-project VPC, peering and transit gateway, listed as a GPU cloud platform feature.
Dedicated infrastructureSingle-tenant runs workloads in an isolated VPC in Baseten Cloud with compute restricted to your organization; Enterprise, custom pricing.Deployments give a dedicated inference endpoint on exclusive GPUs, unlike serverless endpoints that share compute with other users.

Only criteria both providers publish appear here; a tinted cell marks a real difference. Criteria only one of them documents are listed below, and an absence there means we found no source — not that the feature is missing. How we source this.

The small bar above a value is inetGeek's own lean toward that side — computed from the same facts shown, never a number the provider published. See the picker below "The short answer" to weigh only the criteria you care about.

02.

Where they differ.

Free tier

Baseten
No — New workspaces get starting credits for testing; usage beyond them is billed per minute.
Novita AI
Yes — Three inclusionAI Ling 3.0 Flash variants are listed at $0 input and $0 output; all other models are paid per token.
Sources (2) →

Kind of free offer

Baseten
Free credit
Novita AI
Free tier
Sources (2) →

Entry paid plan

Baseten
$0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee.
Novita AI
No plan fee — credit is prepaid, and a manual top-up must be greater than $10.
Sources (2) →

Pricing model

Baseten
No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate.
Novita AI
Per-token serverless inference with a cache-read rate published beside most models, and GPU instances offered at both on-demand and spot rates — the spot column is roughly half. Two models, Ling 3.0 Flash Fin and Sante, are listed at no charge on both input and output.
Sources (2) →
  • Pricing — Baseten ↗

    “$0 per month, pay as you go [...] Only pay for the compute you use, down to the minute. Volume discounts available [...] Pro Unlimited autoscaling and priority compute access [...] Priority access to high-demand GPUs”

    Read 2026-09-06 · official pricing · Report a correction

  • Pricing — Novita AI ↗

    “Ling 3.0 Flash Fin 256K Free Free [...] Ling 3.0 Flash Sante 256K Free Free [...] On-Demand SPOT”

    Read 2026-09-07 · official pricing · Report a correction

Regions

Baseten
Two Baseten regions selectable for regional deployments: us (United States) and eu (European Union); other regions by request to support. GPU model deployments only; Chains, training jobs and shared CPU types cannot select a region.
Novita AI
GPU cloud page advertises 14 global regions in its feature list and, lower on the same page, 20+ locations across 4+ continents.
Sources (2) →

Input price, top model

Baseten
$1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
Novita AI
$2.00 per million input tokens for Qwen3.8 Max, the most expensive model in its catalogue, with cache reads at $0.25 and output at $6.00.
Sources (2) →

Output price, top model

Baseten
$4.40 per million output tokens for GLM-5.3.
Novita AI
$6.00 per million output tokens for Qwen3.8 Max.
Sources (2) →

Input price, cheapest model

Baseten
$0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
Novita AI
$0.075 per million input tokens for GLM 5.3 Flash at short context, rising to $0.15 above the threshold, with cache reads at $0.015 and output at $0.25. Fireworks serves the same model at $0.15.
Sources (2) →

Context window

Baseten

1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.

Novita AI

1M tokens on the DeepSeek V4 line and GLM 5.3, published as "1M" rather than an exact figure — so it is recorded at 1,000,000 and may in practice be the 1,048,576 other providers state. Qwen3.8 is listed at 977K.

Sources (2) →

Max output tokens

Baseten
262K tokens on most models, and it is a separate ceiling from the context window rather than the remainder of it: DeepSeek V4 Flash 0731 allows 384K output inside a 1,048K window, while GLM 4.7, Nemotron Ultra and GPT OSS 120B cap output at their full context. The Inkling models are the outlier at 32K.
Novita AI
128K (131,072) maximum output tokens for Qwen3.8 Max, the highest-priced model in the catalogue, against a 977K context.
Sources (2) →

Rate limits

Baseten
Two limits, requests and tokens per minute, set by account status rather than spend: an unverified Basic account gets 15 RPM and 100,000 TPM, a verified Basic or Pro account 120 RPM and 500,000 TPM, Enterprise custom. Cached input counts toward TPM at full weight even though it is billed cheaper.
Novita AI
Per-model RPM and TPM ceilings set by account tier T1–T5, where tier follows monthly top-ups: T1 up to $50 a month, T5 at least $10,000 in one of the last three months.
Sources (2) →
  • Pricing and limits — Baseten Docs ↗

    “Basic (unverified) | 15 | 100,000 | Basic (verified) | 120 | 500,000 | Pro | 120 | 500,000 [...] Cached and uncached input tokens count equally toward this limit, even though cached tokens cost less.”

    Read 2026-09-07 · official docs · Report a correction

  • Rate limits — Novita AI Documentation ↗

    “Each account has a default rate limit for model calls, measured in RPM (requests per model per minute) and TPM (tokens per model per minute). [...] T1 Monthly top-ups did not exceed $50 in any of the last 3 calendar months. [...] T5 Monthly top-ups were at least $10,000 in at least one of the last 3 calendar months.”

    Read 2026-09-13 · official docs · Report a correction

H100 SXM, per GPU-hour

Baseten
$6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633.
Novita AI
$3.39 per GPU-hour for an on-demand H100 SXM 80GB, or $1.70 spot.
Sources (2) →
  • Pricing — Baseten ↗

    “Dedicated Deployments Only pay for the compute you use, down to the minute. [...] Price per Minute Hour [...] A100 80 GiB VRAM $0.06667 [...] H100 80 GiB VRAM $0.10833 [...] B200 180 GiB VRAM $0.16633”

    Read 2026-09-06 · official pricing · Report a correction

  • Novita AI GPU Cloud ↗

    “On-Demand SPOT H100 SXM 80GB 80 GB VRAM 3.39/hr/GPU 1.70/hr/GPU RTX 4090 24GB 24 GB VRAM 0.33/hr/GPU 0.17/hr/GPU”

    Read 2026-09-14 · official pricing · Report a correction

Largest GPU offered

Baseten

180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour.

Novita AI

80GB per GPU on an H100 SXM, the largest card it lists; below it are an L40S 48GB, RTX 5090 32GB and RTX 4090 24GB.

Sources (2) →

SOC 2

Baseten
Maintains SOC 2 Type II certification for the inference platform; policies and certifications are held in the Baseten Trust Center.
Novita AI
SOC 2 Type II; the audit report is available under NDA to enterprise customers on request through the Trust Center.
Sources (2) →

HIPAA

Baseten
Maintains HIPAA compliance alongside SOC 2 Type II for model inference on the Baseten platform.
Novita AI
Not by default configured to comply with HIPAA, FISMA or GLBA; the Terms of Service direct affected users to contact support for enterprise arrangements. Terms of Use section 1, page updated August 5, 2026.
Sources (2) →
  • Secure model inference - Baseten ↗

    “Baseten maintains SOC 2 Type II certification and HIPAA compliance.”

    Read 2026-09-13 · official docs · Report a correction

  • Novita AI Terms of Service ↗

    “The Site is not by default configured to comply with certain industry-specific regulations (including HIPAA, FISMA, and GLBA). If your use of the Site or Marketplace Offerings is subject to such laws, please contact us at support@novita.ai to discuss enterprise compliance arrangements before proceeding.”

    Read 2026-09-13 · official site · Report a correction

GDPR / data residency

Baseten
Baseten Cloud supports a GDPR compliance program; residency is set with regional environments or a region on a single deployment.
Novita AI
GDPR compliance claimed; EU/EEA transfers rely on Standard Contractual Clauses (Module 2), UK transfers on the IDTA or UK Addendum.
Sources (2) →
  • Baseten Cloud - Baseten ↗

    “Baseten Cloud supports SOC 2 Type II, HIPAA, and GDPR compliance programs. [...] to constrain workloads and inference traffic to specific regions”

    Read 2026-09-13 · official docs · Report a correction

  • Novita AI Trust Center — FAQ ↗

    “GDPR Compliance: Aligned with EU requirements [...] Standard Contractual Clauses (SCCs) — European Commission Decision 2021/914 (Module 2: Controller-to-Processor), as appropriate to your deployment model”

    Read 2026-09-13 · official site · Report a correction

Encryption at rest

Baseten
Trust Center control: datastores housing sensitive customer data are encrypted at rest, and transmission over public networks is encrypted.
Novita AI
AES-256 for data at rest; TLS 1.2+ in transit between customers, Novita and its service providers.
Sources (2) →
  • Baseten Trust Center - Controls ↗

    “The company's datastores housing sensitive customer data are encrypted at rest. [...] The company uses secure data transmission protocols to encrypt confidential and sensitive data when transmitted over public networks.”

    Read 2026-09-13 · official site · Report a correction

  • Novita AI Trust Center — FAQ ↗

    “Data at rest: AES-256 encryption for stored data [...] Data in transit: TLS 1.2+ encryption between you and our services, and between us and our service providers”

    Read 2026-09-13 · official site · Report a correction

Role-based access control

Baseten
Role-based access control with three organization roles - Admin, Member and Viewer - in a single-team organization.
Novita AI
Team accounts define five roles — Owner, Admin, Developer, Basic and Billing — each with read/write or view-only rights over all or only self-created resources.
Sources (2) →
  • Access control - Baseten ↗

    “Baseten uses role-based access control (RBAC) to manage organization access. [...] In organizations that use a single team, every organization member has one of three roles.”

    Read 2026-09-13 · official docs · Report a correction

  • Team — Novita AI Documentation ↗

    “Role is a set of permissions that define what actions a member can perform within a team. There are 5 roles in one team: [...] Action : Either Read/Write (create, update, delete, query) or View (query and list only). [...] Owner The highest level of permission. Manages the team, billing, and all resources. Each team has exactly one Owner.”

    Read 2026-09-13 · official docs · Report a correction

Private networking / VPC

Baseten
Single-tenant Enterprise environments expose endpoints via AWS PrivateLink or Google Cloud Private Service Connect, off the public internet.
Novita AI
Per-project VPC, peering and transit gateway, listed as a GPU cloud platform feature.
Sources (2) →

Dedicated infrastructure

Baseten
Single-tenant runs workloads in an isolated VPC in Baseten Cloud with compute restricted to your organization; Enterprise, custom pricing.
Novita AI
Deployments give a dedicated inference endpoint on exclusive GPUs, unlike serverless endpoints that share compute with other users.
Sources (2) →

When these numbers change, hear about it. Sources are re-checked monthly; a repricing goes out as a short note.

Confirm by email; unsubscribe from any issue. Your address goes to Kit and nowhere else — what we do with it.

03.

Documented by only one.

These criteria are published by one provider and not the other. An absence here means we have not found a source, not that the feature is missing — except where we say we read the other provider's own page on a given date and it does not state it. Those rows lean, and the provider can correct them with a link.

Uptime SLABaseten: Custom SLAs on Enterprise. No percentage is published on the pricing page.
Batch discountNovita AI: Introductory 50% discount on input and output tokens for supported models when submitted through the Batch API.
Support on entry paid planBaseten: Email and in-app chat support on Basic, which is pay-as-you-go from $0. Pro adds dedicated support on Slack and Zoom.
ISO 27001Baseten: ISO 27001:2022 listed as a compliance program; an ISO 27001 certificate for Baseten Labs, Inc. is published in the Trust Center for request. Certificate is request-access in the Trust Center, not a public download.
PCI DSSBaseten: PCI DSS - SAQ D listed as a compliance program; a PCI-DSS v4.0.1 AOC for SAQ D Service Provider is published in the Trust Center for request. SAQ D self-assessment AOC, not a QSA Report on Compliance.
Customer-managed keysBaseten: Runtime OIDC BYOK recipes: a model fetches customer-managed keys at runtime to decrypt encrypted weights and to decrypt requests and encrypt responses. Documented under runtime OIDC use cases, implemented in model code via the truss-examples envelope-encryption recipes.
04.

Questions this comparison answers.

Entry paid plan: Baseten or Novita AI?

Baseten: $0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee.

Novita AI: No plan fee — credit is prepaid, and a manual top-up must be greater than $10.

Free tier: Baseten or Novita AI?

Baseten: No — New workspaces get starting credits for testing; usage beyond them is billed per minute.

Novita AI: Yes — Three inclusionAI Ling 3.0 Flash variants are listed at $0 input and $0 output; all other models are paid per token.

Should I choose Baseten or Novita AI?

Pick Baseten if Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.

Pick Novita AI if Breadth — 200+ models under one API with a cache-read rate published next to most of them, and an H100 SXM at $3.39 an hour if the same vendor should run the dedicated side too.

Provider pages

Related comparisons

Comments

Every page here is sourced and dated.