DeepInfra vs Baseten
SEPT 2026 auditA comparison of DeepInfra and Baseten built from values read directly from each provider's own documentation, with the source recorded against every figure.
The short answer
Choose DeepInfra if…
Running open-weight models at the lowest published per-token rates here — DeepSeek-V4-Flash at $0.06 per million input is a fraction of what the lab itself charges — with dedicated H100s at $2.20 an hour if throughput demands it.
Editorial · Palash Bagchi · approved
Choose Baseten if…
Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.
Editorial · Palash Bagchi · approved
Consider something else if…
- DeepInfra: Only some models carry per-token pricing; the rest bill for inference execution time, which is a different and harder thing to forecast.
- Baseten: Its dedicated H100 works out at $6.50 an hour, roughly three times DeepInfra's, so steady GPU workloads pay a premium for the platform around them.
19 sourced criteria separate them — see where, with sources, below.
Pick the criteria you care about. The chart counts how many of them lean toward each provider — the same read as scanning the bars below, just totalled for the ones you chose.
DeepInfra 0
Baseten 0
At a glance.
| Criterion | DeepInfra | Baseten |
|---|---|---|
| Pricing | ||
| Free tier | No | No — New workspaces get starting credits for testing; usage beyond them is billed per minute. |
| Kind of free offer | No free offer | Free credit |
| Entry paid plan | No minimum spend and no seat fees - billing is pay-per-token usage only, with no charge for idle GPU time. | $0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee. |
| Pricing model | Two products on one bill: per-token serverless inference with a separate cached-input rate for each model, and dedicated GPUs billed per minute and invoiced weekly. Models without per-token pricing are billed for inference execution time instead. | No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate. |
| Infrastructure | ||
| Regions | Serverless inference runs on DeepInfra's own inference-optimised infrastructure in US-based data centers. No region selector is documented for the shared inference API. | Two Baseten regions selectable for regional deployments: us (United States) and eu (European Union); other regions by request to support. GPU model deployments only; Chains, training jobs and shared CPU types cannot select a region. |
| Inference | ||
| Input price, top model | $1.30 per million input tokens for DeepSeek-V4-Pro, the most expensive model in its catalogue. Cached input is $0.10. | $1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10. |
| Output price, top model | $2.60 per million output tokens for DeepSeek-V4-Pro. | $4.40 per million output tokens for GLM-5.3. |
| Input price, cheapest model | $0.06 per million input tokens for DeepSeek-V4-Flash-0731, with cached input at $0.015 and output at $0.18. DeepSeek itself charges $0.44 at peak for the same checkpoint and Fireworks $0.22. | $0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out. |
| Context window | 1024k tokens on the DeepSeek V4 models it serves; 160k on the V3 generation. The window is the model's rather than a platform limit. | 1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it. |
| Max output tokens | Hard cap of 16384 output tokens per response for most models on the chat completions API; the exact limit is model-dependent. | 262K tokens on most models, and it is a separate ceiling from the context window rather than the remainder of it: DeepSeek V4 Flash 0731 allows 384K output inside a 1,048K window, while GLM 4.7, Nemotron Ultra and GPT OSS 120B cap output at their full context. The Inkling models are the outlier at 32K. |
| Prompt caching | Supported | Supported |
| Rate limits | Default 200 concurrent requests per model per account (429 above it); a limit increase can be requested in the dashboard. | Two limits, requests and tokens per minute, set by account status rather than spend: an unverified Basic account gets 15 RPM and 100,000 TPM, a verified Basic or Pro account 120 RPM and 500,000 TPM, Enterprise custom. Cached input counts toward TPM at full weight even though it is billed cheaper. |
| GPU | ||
| H100 SXM, per GPU-hour | $2.20 per GPU-hour for a dedicated H100 80GB — below every dedicated cloud in this dataset. A100 80GB is $0.89, H200 $2.69, B200 $3.69. Billed in minute granularity, invoiced weekly. | $6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633. |
| Largest GPU offered | 270GB per GPU on a B300, at $4.89 per GPU-hour. | 180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour. |
| Compliance | ||
| SOC 2 | Security measures stated to comply with SOC 2 standards in the privacy policy; no report, audit type or auditor is published. | Maintains SOC 2 Type II certification for the inference platform; policies and certifications are held in the Baseten Trust Center. |
| ISO 27001 | Security measures stated to comply with ISO 27001 standards in the privacy policy; no certificate or issuing body is published. | ISO 27001:2022 listed as a compliance program; an ISO 27001 certificate for Baseten Labs, Inc. is published in the Trust Center for request. Certificate is request-access in the Trust Center, not a public download. |
| HIPAA | Technical and organizational measures for HIPAA compliance stated in the privacy policy; no BAA or eligible-services list is published. | Maintains HIPAA compliance alongside SOC 2 Type II for model inference on the Baseten platform. |
| GDPR / data residency | Privacy Policy: data may be transferred, stored and processed outside your jurisdiction, specifically in the United States; EU residents keep GDPR rights. | Baseten Cloud supports a GDPR compliance program; residency is set with regional environments or a region on a single deployment. |
| Encryption at rest | Inference inputs and outputs are not stored to disk; bulk-inference data may be stored on disk in encrypted form, then deleted. | Trust Center control: datastores housing sensitive customer data are encrypted at rest, and transmission over public networks is encrypted. |
| Role-based access control | Team roles are member and admin; an admin can change roles, but all team members share the same API tokens and models. | Role-based access control with three organization roles - Admin, Member and Viewer - in a single-team organization. |
| Dedicated infrastructure | Private model deployments run on dedicated GPU infrastructure - your weights, your endpoint, your isolation - not shared with other users. | Single-tenant runs workloads in an isolated VPC in Baseten Cloud with compute restricted to your organization; Enterprise, custom pricing. |
Where they differ.
Kind of free offer
- DeepInfra
- No free offer
- Baseten
- Free credit
Sources (2) →Sources ↓
- Simple Pricing | Machine Learning Infrastructure | DeepInfra ↗
“You have to add a card or pre-pay [...] Pre-paid accounts draw down their balance as they go, and invoiced accounts are billed once at the beginning of the following month.”
Read 2026-09-13 · official pricing · Report a correction
- Billing and usage - Baseten ↗
“Baseten doesn’t offer a separate free tier or perpetual free plan. [...] New workspaces receive credits for testing and deployment.”
Read 2026-09-13 · official docs · Report a correction
Entry paid plan
- DeepInfra
- No minimum spend and no seat fees - billing is pay-per-token usage only, with no charge for idle GPU time.
- Baseten
- $0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee.
Sources (2) →Sources ↓
- What is DeepInfra - DeepInfra ↗
“You only pay per token - no idle GPU time, no minimums, no seat fees.”
Read 2026-09-13 · official docs · Report a correction
- Pricing — Baseten ↗
“Baseten $0 per month, pay as you go Get started [...] Included in Basic: Dedicated deployments Model APIs Training Fast cold starts SOC 2 Type II and HIPAA compliant”
Read 2026-09-06 · official pricing · Report a correction
Pricing model
- DeepInfra
- Two products on one bill: per-token serverless inference with a separate cached-input rate for each model, and dedicated GPUs billed per minute and invoiced weekly. Models without per-token pricing are billed for inference execution time instead.
- Baseten
- No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate.
Sources (2) →Sources ↓
- Pricing — DeepInfra ↗
“Some of our langauge models offer per token pricing. Most other models are billed for inference execution time. [...] Billed in minute granularity Invoiced weekly”
Read 2026-09-06 · official pricing · Report a correction
- Pricing — Baseten ↗
“$0 per month, pay as you go [...] Only pay for the compute you use, down to the minute. Volume discounts available [...] Pro Unlimited autoscaling and priority compute access [...] Priority access to high-demand GPUs”
Read 2026-09-06 · official pricing · Report a correction
Regions
- DeepInfra
- Serverless inference runs on DeepInfra's own inference-optimised infrastructure in US-based data centers. No region selector is documented for the shared inference API.
- Baseten
- Two Baseten regions selectable for regional deployments: us (United States) and eu (European Union); other regions by request to support. GPU model deployments only; Chains, training jobs and shared CPU types cannot select a region.
Sources (2) →Sources ↓
- Machine Learning Models and Infrastructure | DeepInfra ↗
“DeepInfra runs on our own cutting-edge inference optimised infrastructure, in secure US-based data centers.”
Read 2026-09-13 · official site · Report a correction
- Regional deployments - Baseten ↗
“The following regions are available for regional deployments. [...] us United States eu European Union”
Read 2026-09-13 · official docs · Report a correction
Input price, top model
- DeepInfra
- $1.30 per million input tokens for DeepSeek-V4-Pro, the most expensive model in its catalogue. Cached input is $0.10.
- Baseten
- $1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
Sources (2) →Sources ↓
- Pricing — DeepInfra ↗
“DeepSeek-V4-Pro 1024k $1.30 / $0.10 cached $2.60”
Read 2026-09-06 · official pricing · Report a correction
- Pricing — Baseten ↗
“GLM-5.3 GLM-5.3 $1.40 $1.40 $0.14 $0.14 $4.40 [...] GLM-5.2 Fast GLM-5.2 Fast $2.10 $2.10 $0.21”
Read 2026-09-06 · official pricing · Report a correction
Output price, top model
- DeepInfra
- $2.60 per million output tokens for DeepSeek-V4-Pro.
- Baseten
- $4.40 per million output tokens for GLM-5.3.
Sources (2) →Sources ↓
- Pricing — DeepInfra ↗
“DeepSeek-V4-Pro 1024k $1.30 / $0.10 cached $2.60”
Read 2026-09-06 · official pricing · Report a correction
- Pricing — Baseten ↗
“GLM-5.3 GLM-5.3 $1.40 $1.40 $0.14 $0.14 $4.40”
Read 2026-09-06 · official pricing · Report a correction
Input price, cheapest model
- DeepInfra
- $0.06 per million input tokens for DeepSeek-V4-Flash-0731, with cached input at $0.015 and output at $0.18. DeepSeek itself charges $0.44 at peak for the same checkpoint and Fireworks $0.22.
- Baseten
- $0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
Sources (2) →Sources ↓
- Pricing — DeepInfra ↗
“DeepSeek-V4-Flash-0731 1024k $0.06 / $0.015 cached $0.18”
Read 2026-09-06 · official pricing · Report a correction
- Pricing — Baseten ↗
“GPT OSS 120B GPT OSS 120B $0.10 $0.10 - - $0.50 [...] GLM-5.3-Flash GLM-5.3-Flash $0.15 $0.15 $0.03 $0.03 $0.50”
Read 2026-09-06 · official pricing · Report a correction
Context window
1024k tokens on the DeepSeek V4 models it serves; 160k on the V3 generation. The window is the model's rather than a platform limit.
1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.
Sources (2) →Sources ↓
- Pricing — DeepInfra ↗
“DeepSeek-V4-Pro 1024k [...] DeepSeek-V3.2 160k $0.26 / $0.13 cached $0.38”
Read 2026-09-06 · official pricing · Report a correction
- Model APIs overview — Baseten Docs ↗
“SupportedModelsTable [...] model: "DeepSeek V4 Pro", context: 1048, maxOutput: 262 [...] model: "GLM 5.3", context: 1048, maxOutput: 262 [...] model: "GLM 4.7", context: 200, maxOutput: 200 [...] model: "OpenAI GPT 120B", context: 128, maxOutput: 128”
Read 2026-09-08 · official docs · Report a correction
Max output tokens
- DeepInfra
- Hard cap of 16384 output tokens per response for most models on the chat completions API; the exact limit is model-dependent.
- Baseten
- 262K tokens on most models, and it is a separate ceiling from the context window rather than the remainder of it: DeepSeek V4 Flash 0731 allows 384K output inside a 1,048K window, while GLM 4.7, Nemotron Ultra and GPT OSS 120B cap output at their full context. The Inkling models are the outlier at 32K.
Sources (2) →Sources ↓
- Chat Completions - DeepInfra ↗
“The maximum number of tokens that can be generated in a single response is model-dependent, with a hard cap of 16384 tokens for most models.”
Read 2026-09-13 · official docs · Report a correction
- Model APIs overview — Baseten Docs ↗
“SupportedModelsTable [...] model: "DeepSeek V4 Pro", context: 1048, maxOutput: 262 [...] model: "GLM 5.3", context: 1048, maxOutput: 262 [...] model: "GLM 4.7", context: 200, maxOutput: 200 [...] model: "OpenAI GPT 120B", context: 128, maxOutput: 128”
Read 2026-09-08 · official docs · Report a correction
Rate limits
- DeepInfra
- Default 200 concurrent requests per model per account (429 above it); a limit increase can be requested in the dashboard.
- Baseten
- Two limits, requests and tokens per minute, set by account status rather than spend: an unverified Basic account gets 15 RPM and 100,000 TPM, a verified Basic or Pro account 120 RPM and 500,000 TPM, Enterprise custom. Cached input counts toward TPM at full weight even though it is billed cheaper.
Sources (2) →Sources ↓
- Rate Limits - DeepInfra ↗
“Every account has a default limit of 200 concurrent requests per model [...] You can request a rate limit increase in your”
Read 2026-09-13 · official docs · Report a correction
- Pricing and limits — Baseten Docs ↗
“Basic (unverified) | 15 | 100,000 | Basic (verified) | 120 | 500,000 | Pro | 120 | 500,000 [...] Cached and uncached input tokens count equally toward this limit, even though cached tokens cost less.”
Read 2026-09-07 · official docs · Report a correction
H100 SXM, per GPU-hour
- DeepInfra
- $2.20 per GPU-hour for a dedicated H100 80GB — below every dedicated cloud in this dataset. A100 80GB is $0.89, H200 $2.69, B200 $3.69. Billed in minute granularity, invoiced weekly.
- Baseten
- $6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633.
Sources (2) →Sources ↓
- Pricing — DeepInfra ↗
“A100 80GB $0.89 / GPU-hour H100 80GB $2.20 / GPU-hour H200 141GB $2.69 / GPU-hour B200 180GB $3.69 / GPU-hour B300 270GB $4.89 / GPU-hour [...] Billed in minute granularity Invoiced weekly”
Read 2026-09-06 · official pricing · Report a correction
- Pricing — Baseten ↗
“Dedicated Deployments Only pay for the compute you use, down to the minute. [...] Price per Minute Hour [...] A100 80 GiB VRAM $0.06667 [...] H100 80 GiB VRAM $0.10833 [...] B200 180 GiB VRAM $0.16633”
Read 2026-09-06 · official pricing · Report a correction
Largest GPU offered
270GB per GPU on a B300, at $4.89 per GPU-hour.
180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour.
Sources (2) →Sources ↓
- Pricing — DeepInfra ↗
“B300 270GB $4.89 / GPU-hour”
Read 2026-09-06 · official pricing · Report a correction
- Pricing — Baseten ↗
“B200 180 GiB VRAM $0.16633 Deploy”
Read 2026-09-06 · official pricing · Report a correction
SOC 2
- DeepInfra
- Security measures stated to comply with SOC 2 standards in the privacy policy; no report, audit type or auditor is published.
- Baseten
- Maintains SOC 2 Type II certification for the inference platform; policies and certifications are held in the Baseten Trust Center.
Sources (2) →Sources ↓
- Privacy Policy — DeepInfra ↗
“Our security measures comply with SOC 2 and ISO 27001 standards and include technical and organizational measures for GDPR and HIPAA”
Read 2026-09-13 · official site · Report a correction
- Secure model inference - Baseten ↗
“Baseten maintains SOC 2 Type II certification and HIPAA compliance.”
Read 2026-09-13 · official docs · Report a correction
ISO 27001
- DeepInfra
- Security measures stated to comply with ISO 27001 standards in the privacy policy; no certificate or issuing body is published.
- Baseten
- ISO 27001:2022 listed as a compliance program; an ISO 27001 certificate for Baseten Labs, Inc. is published in the Trust Center for request. Certificate is request-access in the Trust Center, not a public download.
Sources (2) →Sources ↓
- Privacy Policy — DeepInfra ↗
“Our security measures comply with SOC 2 and ISO 27001 standards and include technical and organizational measures for GDPR and HIPAA”
Read 2026-09-13 · official site · Report a correction
- Baseten Trust Center ↗
“Compliance SOC 2 ISO 27001:2022 HIPAA [...] Baseten Labs, Inc. ISO 27001 Certificate.pdf”
Read 2026-09-13 · official site · Report a correction
HIPAA
- DeepInfra
- Technical and organizational measures for HIPAA compliance stated in the privacy policy; no BAA or eligible-services list is published.
- Baseten
- Maintains HIPAA compliance alongside SOC 2 Type II for model inference on the Baseten platform.
Sources (2) →Sources ↓
- Privacy Policy — DeepInfra ↗
“Our security measures comply with SOC 2 and ISO 27001 standards and include technical and organizational measures for GDPR and HIPAA”
Read 2026-09-13 · official site · Report a correction
- Secure model inference - Baseten ↗
“Baseten maintains SOC 2 Type II certification and HIPAA compliance.”
Read 2026-09-13 · official docs · Report a correction
GDPR / data residency
- DeepInfra
- Privacy Policy: data may be transferred, stored and processed outside your jurisdiction, specifically in the United States; EU residents keep GDPR rights.
- Baseten
- Baseten Cloud supports a GDPR compliance program; residency is set with regional environments or a region on a single deployment.
Sources (2) →Sources ↓
- DeepInfra Privacy Policy ↗
“Your data may be transferred, stored, and processed outside of your jurisdiction, specifically in the United States. [...] If you are a resident of the European Union you may have additional rights under the General Data Protection Regulation.”
Read 2026-09-13 · official site · Report a correction
- Baseten Cloud - Baseten ↗
“Baseten Cloud supports SOC 2 Type II, HIPAA, and GDPR compliance programs. [...] to constrain workloads and inference traffic to specific regions”
Read 2026-09-13 · official docs · Report a correction
Encryption at rest
- DeepInfra
- Inference inputs and outputs are not stored to disk; bulk-inference data may be stored on disk in encrypted form, then deleted.
- Baseten
- Trust Center control: datastores housing sensitive customer data are encrypted at rest, and transmission over public networks is encrypted.
Sources (2) →Sources ↓
- Data Privacy - DeepInfra ↗
“Input data is not stored to disk during inference [...] we may need to store data for a longer period, potentially on disk in encrypted form”
Read 2026-09-13 · official docs · Report a correction
- Baseten Trust Center - Controls ↗
“The company's datastores housing sensitive customer data are encrypted at rest. [...] The company uses secure data transmission protocols to encrypt confidential and sensitive data when transmitted over public networks.”
Read 2026-09-13 · official site · Report a correction
Role-based access control
- DeepInfra
- Team roles are member and admin; an admin can change roles, but all team members share the same API tokens and models.
- Baseten
- Role-based access control with three organization roles - Admin, Member and Viewer - in a single-team organization.
Sources (2) →Sources ↓
- Okta SSO - DeepInfra ↗
“Admin can change team member roles (member / admin) [...] All team members share the same API tokens and models [...] For per-user isolation (separate tokens and models per person), contact us”
Read 2026-09-13 · official docs · Report a correction
- Access control - Baseten ↗
“Baseten uses role-based access control (RBAC) to manage organization access. [...] In organizations that use a single team, every organization member has one of three roles.”
Read 2026-09-13 · official docs · Report a correction
Dedicated infrastructure
- DeepInfra
- Private model deployments run on dedicated GPU infrastructure - your weights, your endpoint, your isolation - not shared with other users.
- Baseten
- Single-tenant runs workloads in an isolated VPC in Baseten Cloud with compute restricted to your organization; Enterprise, custom pricing.
Sources (2) →Sources ↓
- Deploy Private Models - DeepInfra ↗
“DeepInfra allows you to deploy your own models on dedicated infrastructure [...] data stays on dedicated infrastructure, not shared with other users”
Read 2026-09-13 · official docs · Report a correction
- Single-tenant - Baseten ↗
“Single-tenant runs your inference workloads in an isolated VPC in Baseten Cloud. [...] Compute and scheduling are restricted to your organization. [...] Single-tenant is available with custom pricing on the Enterprise plan.”
Read 2026-09-13 · official docs · Report a correction
When these numbers change, hear about it. Sources are re-checked monthly; a repricing goes out as a short note.
Documented by only one.
These criteria are published by one provider and not the other. An absence here means we have not found a source, not that the feature is missing — except where we say we read the other provider's own page on a given date and it does not state it. Those rows lean, and the provider can correct them with a link.
Questions this comparison answers.
Entry paid plan: DeepInfra or Baseten?
DeepInfra: No minimum spend and no seat fees - billing is pay-per-token usage only, with no charge for idle GPU time.
Baseten: $0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee.
Should I choose DeepInfra or Baseten?
Pick DeepInfra if Running open-weight models at the lowest published per-token rates here — DeepSeek-V4-Flash at $0.06 per million input is a fraction of what the lab itself charges — with dedicated H100s at $2.20 an hour if throughput demands it.
Pick Baseten if Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.
Comments are hosted by EchoThread, which sets cookies and offers social sign-in. Like the analytics on this site, it does not load until you accept — see the privacy page.