Baseten Hybrid: control and flexibility in your cloud and ours
Get the performance of a managed service in your own VPC, with seamless overflow to Baseten Cloud.
++++High-performance inference with seamless overflow
Flex your cloud
Maintain SLAs during traffic spikes, avoid vendor lock-in, and leverage existing cloud credits with our effortless multi-cloud routing.
Cut latency
With rapid cold starts and tailored model performance, our customers achieve lower overall latency and faster time to first token.
Designed for compliance
Keep sensitive workloads in your VPC, and lean on the SOC 2 Type II, HIPAA, and GDPR compliance of Baseten Cloud.
Choosing Baseten Hybrid, Self-hosted, or Cloud
 Baseten Hybrid |  Baseten Self-hosted |  Baseten Cloud | |
|---|---|---|---|
Feature | |||
Data control | Full data control in your VPC; managed data security on Baseten Cloud | Full data control | Managed data security; we never store model inputs or outputs |
Data residency requirements | Region-locked data and deployments with multi-region support | Region-locked data and deployments | Multi-region support with global deployment options |
Compute capacity | Leverage existing resources or Baseten compute for overflow | Leverage existing in-house resources | Leverage on-demand compute with SOTA GPUs |
Cost efficiency | Use in-house compute whenever available for optimized costs | Utilize dedicated resources without extra spend on hardware | Gain cost-effective, on-demand compute |
Integration with internal systems | Custom or out-of-the-box integrations | Custom or out-of-the-box integrations | Easy integration via Baseten's ecosystem |
Performance optimization | SOTA on-chip model performance and low network latency | SOTA on-chip model performance and low network latency | SOTA on-chip model performance and low network latency |
Scalability | High, tailored scalability with flex capacity on Baseten Cloud | High, tailored scalability | High, flexible scaling options |
Security and compliance | Adhere to custom policies and our SOC 2 Type II, HIPAA, and GDPR compliance | Adhere to custom organizational policies | SOC 2 Type II certified, HIPAA compliant, and GDPR compliant by default |
Support and maintenance | Comprehensive support and managed services | Comprehensive support and managed services | Comprehensive support and managed services |
Utilization of existing cloud commits | Use credits or commits | Use credits or commits | Spend down existing cloud commits |
Feature
Data control
Data residency requirements
Compute capacity
Cost efficiency
Integration with internal systems
Performance optimization
Scalability
Security and compliance
Support and maintenance
Utilization of existing cloud commits
Get the best of Self-hosted and Cloud deployments
Flex on-demand
Utilize internal resources whenever they’re available, seamlessly transition to Baseten Cloud whenever necessary.
Control data residency
Host in your VPC, or use a dedicated deployment on Baseten Cloud. We never store model inputs or outputs.
Auto-scale to peak demand
Future-proof your product against traffic bursts with our optimized autoscaling and blazing-fast cold starts.
Meet compliance
Store data where you need it, and lean on the SOC 2 Type II, HIPAA, and GDPR compliance of Baseten Cloud.
Optimize costs
Fully use existing hardware or cloud commits, and take advantage of Baseten’s on-demand pricing for overflow.
Ship faster
Save time with out-of-the-box performance optimizations and engineers dedicated to hitting your performance targets.
++++Reliable performance at peak demand
Stress-free traffic spikes
Meet SLAs without investing in additional GPUs. With full cloud elasticity, we manage your workloads wherever there's capacity.
Engineered for speed
Along with our out-of-the-box performance optimizations, get the white glove treatment of our dedicated engineering teams for tailored response times at the millisecond level.
Enterprise compliance
You don't need to sacrifice performance for compliance. Keep sensitive workloads on-prem, and rely on our single-tenant, HIPAA and GDPR compliant, SOC 2 Type II certified infra only when needed.
Get started with Baseten Hybrid
Guides and examples
Learn about the Baseten platform
Learn how Baseten infra operates in both Cloud and Self-hosted deployments.
Security and compliance
Learn how we ensure security and compliance in Hybrid, Self-hosted, and Cloud deployments.
You guys have literally enabled us to hit insane revenue numbers without ever thinking about GPUs and scaling. I know I ask for a lot so I just wanted to let you guys know that I am so blown away by everything Baseten.
Rime’s state-of-the-art p99 latency and 100% uptime over 2024 is driven by our shared laser focus on fundamentals, and we’re excited to push the frontier even further with Baseten.
Baseten enabled us to achieve something remarkable—delivering real-time AI phone calls with sub-400 millisecond response times. That level of speed set us apart from every competitor.
A week ago we reached out with a hefty goal and within days your team helped us get set up and stable for a launch. It went smoothly, entirely thanks to you guys. 100% couldn’t have gone live without the software and hardware support you guys worked through the weekend to get us. The custom optimized Whisper on Baseten’s autoscaling L4 GPUs saved us.
Inference for custom-built LLMs could be a major headache. Thanks to Baseten, we’re getting cost-effective high-performance model serving without any extra burden on our internal engineering teams. Instead, we get to focus our expertise on creating the best possible domain-specific LLMs for our customers.
You guys have literally enabled us to hit insane revenue numbers without ever thinking about GPUs and scaling. We would be stuck in GPU AWS land without y'all. Truss files are amazing, y'all are on top of it always, and the product is well thought out. I know I ask for a lot so I just wanted to let you guys know that I am so blown away by everything Baseten.
Baseten gets the stuff we don't want to do out of the way. Now, our small, scrappy team can punch above our weight. It's everything from model serving, to auto-scaling, to iterating on products around those models, so we can deliver value to our customers and not worry about ML infrastructure.
Baseten provides an easy way for us to host our models, iterate on them, and experiment without worrying about any of the DevOps involved.
Baseten has allowed us to efficiently build an entirely new machine learning platform in just 4 months. By not needing to worry about managing our model infrastructure, Laurel has been able to drastically reduce our time to develop new predictive features and maintain more than double the number of models from our old platform.
Explore Baseten today
We love partnering with companies developing innovative AI products by providing the most customizable model deployment with the lowest latency.
