# Replicate vs Baseten

Canonical: https://inetgeek.com/compare/replicate-vs-baseten/

Every value below is read from Replicate's and Baseten's own documentation. See https://inetgeek.com/methodology/ for how.

## At a glance

| Criterion | Replicate | Baseten |
| --- | --- | --- |
| Pricing model | Two meters, chosen by the model rather than by you. Public models bill per run — per output image, per thousand tokens, per second of video. Private models you deploy yourself run on dedicated hardware and bill for THE TIME THEY SPEND SETTING UP, THE TIME THEY SPEND IDLE and the time they spend active. Fast-booting fine-tunes are the exception and bill active time only. | No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate. |
| H100 SXM, per GPU-hour | $5.49 per hour for a single Nvidia H100 with 80GB of GPU RAM, published as $0.001525 per second — the rate the per-second meter actually charges. | $6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633. |
| Largest GPU offered | 160GB on the 2x Nvidia A100 (80GB) instance, the largest GPU RAM figure the hardware table states. Larger multi-GPU A100, H100 and H200 configurations are listed but carry no stated GPU RAM and are sold only with committed spend contracts. | 180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour. |
| Support on entry paid plan | Nothing named on the standard product. A dedicated account manager, priority support, higher GPU limits and performance SLAs are all listed under Enterprise and volume discounts, reached by contacting Replicate rather than by picking a plan. | Email and in-app chat support on Basic, which is pay-as-you-go from $0. Pro adds dedicated support on Slack and Zoom. |

## Where they differ

### Pricing model

- Replicate: Two meters, chosen by the model rather than by you. Public models bill per run — per output image, per thousand tokens, per second of video. Private models you deploy yourself run on dedicated hardware and bill for THE TIME THEY SPEND SETTING UP, THE TIME THEY SPEND IDLE and the time they spend active. Fast-booting fine-tunes are the exception and bill active time only. ([source](https://replicate.com/pricing))
- Baseten: No platform fee: per-token Model APIs for open models, and dedicated deployments billed per minute of compute with volume discounts. The Pro tier buys priority access to high-demand GPUs rather than a lower rate. ([source](https://www.baseten.co/pricing/))

### H100 SXM, per GPU-hour

- Replicate: $5.49 per hour for a single Nvidia H100 with 80GB of GPU RAM, published as $0.001525 per second — the rate the per-second meter actually charges. ([source](https://replicate.com/pricing))
- Baseten: $6.50 per hour for a dedicated H100 80GB. Baseten publishes $0.10833 per MINUTE — the hourly figure is that times 60, ours rather than Baseten's, and the page offers an hourly toggle. A100 80GB is $0.06667 a minute and B200 $0.16633. ([source](https://www.baseten.co/pricing/))

### Largest GPU offered

- Replicate: 160GB on the 2x Nvidia A100 (80GB) instance, the largest GPU RAM figure the hardware table states. Larger multi-GPU A100, H100 and H200 configurations are listed but carry no stated GPU RAM and are sold only with committed spend contracts. ([source](https://replicate.com/pricing))
- Baseten: 180GB per GPU on a B200, at $0.16633 per minute — $9.98 an hour. ([source](https://www.baseten.co/pricing/))

### Support on entry paid plan

- Replicate: Nothing named on the standard product. A dedicated account manager, priority support, higher GPU limits and performance SLAs are all listed under Enterprise and volume discounts, reached by contacting Replicate rather than by picking a plan. ([source](https://replicate.com/pricing))
- Baseten: Email and in-app chat support on Basic, which is pay-as-you-go from $0. Pro adds dedicated support on Slack and Zoom. ([source](https://www.baseten.co/pricing/))

## Which should you choose?

Pick Replicate if Running someone else's open model without packaging anything. Thousands of public models bill per run — per output image, per thousand tokens, per second of video — so a workload that fires occasionally pays only for the firing, with no instance to keep warm.

Pick Baseten if Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.

Consider something else: Replicate — You are deploying your own model and it will sit idle. Private models bill the time they spend setting up and waiting as well as working; only fast-booting fine-tunes escape that. The H100 hour is $5.49, against $3.95 on Modal and $3.49 on RunPod.

Consider something else: Baseten — Its dedicated H100 works out at $6.50 an hour, roughly three times DeepInfra's, so steady GPU workloads pay a premium for the platform around them.

## Documented by only one

- Free tier: Baseten: No — New workspaces get starting credits for testing; usage beyond them is billed per minute.
- Kind of free offer: Baseten: Free credit
- Entry paid plan: Baseten: $0 per month on the Basic plan — pay as you go, with dedicated deployments, model APIs and training included rather than gated behind a fee.
- Scales to zero: Replicate: Not supported — Private models bill idle time; fast-booting fine-tunes do not
- Autoscaling: Replicate: Supported — Scales up and down automatically with traffic
- Regions: Baseten: Two Baseten regions selectable for regional deployments: us (United States) and eu (European Union); other regions by request to support. GPU model deployments only; Chains, training jobs and shared CPU types cannot select a region.
- Uptime SLA: Baseten: Custom SLAs on Enterprise. No percentage is published on the pricing page.
- Input price, top model: Baseten: $1.40 per million input tokens for GLM-5.3, with cached input at $0.14 and output at $4.40. GLM-5.2 Fast, a speed variant, is $2.10.
- Output price, top model: Baseten: $4.40 per million output tokens for GLM-5.3.
- Input price, cheapest model: Baseten: $0.10 per million input tokens for GPT OSS 120B, with output at $0.50. GLM-5.3-Flash is $0.15 in and $0.50 out.
- Context window: Baseten: 1,048K tokens on the DeepSeek V4 line and the GLM 5.2/5.3 family, the widest it serves; 262K on the Kimi K2 models, 200K on GLM 4.7 and 128K on GPT OSS 120B. Baseten's table publishes these in thousands, so the magnitude is 1,048,000 rather than the 1,048,576 a power-of-two reading would give — the vendor's own figure, not a conversion of it.
- Max output tokens: Baseten: 262K tokens on most models, and it is a separate ceiling from the context window rather than the remainder of it: DeepSeek V4 Flash 0731 allows 384K output inside a 1,048K window, while GLM 4.7, Nemotron Ultra and GPT OSS 120B cap output at their full context. The Inkling models are the outlier at 32K.
- Prompt caching: Baseten: Supported
- Rate limits: Baseten: Two limits, requests and tokens per minute, set by account status rather than spend: an unverified Basic account gets 15 RPM and 100,000 TPM, a verified Basic or Pro account 120 RPM and 500,000 TPM, Enterprise custom. Cached input counts toward TPM at full weight even though it is billed cheaper.
- Cheapest GPU, per hour: Replicate: $0.81 per hour for an Nvidia T4 with 16GB, the cheapest GPU on the hardware list. A CPU-only instance is cheaper still at $0.09 an hour.
- Billing granularity: Replicate: Per second. Every hardware row publishes a per-second rate alongside the hourly one, and the per-second figure is the meter.
- SOC 2: Baseten: Maintains SOC 2 Type II certification for the inference platform; policies and certifications are held in the Baseten Trust Center.
- ISO 27001: Baseten: ISO 27001:2022 listed as a compliance program; an ISO 27001 certificate for Baseten Labs, Inc. is published in the Trust Center for request. Certificate is request-access in the Trust Center, not a public download.
- HIPAA: Baseten: Maintains HIPAA compliance alongside SOC 2 Type II for model inference on the Baseten platform.
- GDPR / data residency: Baseten: Baseten Cloud supports a GDPR compliance program; residency is set with regional environments or a region on a single deployment.
- PCI DSS: Baseten: PCI DSS - SAQ D listed as a compliance program; a PCI-DSS v4.0.1 AOC for SAQ D Service Provider is published in the Trust Center for request. SAQ D self-assessment AOC, not a QSA Report on Compliance.
- Encryption at rest: Baseten: Trust Center control: datastores housing sensitive customer data are encrypted at rest, and transmission over public networks is encrypted.
- Customer-managed keys: Baseten: Runtime OIDC BYOK recipes: a model fetches customer-managed keys at runtime to decrypt encrypted weights and to decrypt requests and encrypt responses. Documented under runtime OIDC use cases, implemented in model code via the truss-examples envelope-encryption recipes.
- Role-based access control: Baseten: Role-based access control with three organization roles - Admin, Member and Viewer - in a single-team organization.
- Private networking / VPC: Baseten: Single-tenant Enterprise environments expose endpoints via AWS PrivateLink or Google Cloud Private Service Connect, off the public internet.
- Dedicated infrastructure: Baseten: Single-tenant runs workloads in an isolated VPC in Baseten Cloud with compute restricted to your organization; Enterprise, custom pricing.

## Questions this comparison answers

**Should I choose Replicate or Baseten?**

Pick Replicate if Running someone else's open model without packaging anything. Thousands of public models bill per run — per output image, per thousand tokens, per second of video — so a workload that fires occasionally pays only for the firing, with no instance to keep warm.
Pick Baseten if Teams that want per-token APIs and dedicated GPUs from one vendor with no plan fee — minute-granularity billing means a model that runs for ten minutes costs ten minutes.