Live podcast: What we learned building compound AI from our customers
Deploying AI workflows with multiple models is hard. Keeping them performant at scale is even harder.
In our first podcast, we'll explain live how you can build and ship ultra-performant, reliable, and cost-efficient compound AI systems in production.
Join us on March 6th and learn:
What compound AI systems are and why they’re changing the AI landscape
Why compound AI systems are difficult to serve in production
Where performance bottlenecks come from
The hidden costs of compound AI
Baseten Chains: An SDK for serving compound AI
Optimizing compound AI performance in production
How compound AI will evolve in 2025
We’ll walk through real-world use cases and showcase live demos, with time for questions at the end for attendees who join us live.
Register now and secure your spot!
Host
Speakers
Announcing Baseten’s $75M Series C
Baseten raised a $75M Series C to power mission-critical AI inference for leading AI companies.
How multi-node inference works for massive LLMs like DeepSeek-R1
Running DeepSeek-R1 on H100 GPUs requires multi-node inference to connect the 16 H100s needed to hold the model weights.
Testing Llama 3.3 70B inference performance on NVIDIA GH200 in Lambda Cloud
The NVIDIA GH200 Superchip combines an NVIDIA Hopper GPU with an ARM CPU via high-bandwidth interconnect
Baseten Chains is now GA for production compound AI systems
Baseten Chains delivers ultra-low-latency compound AI at scale, with custom hardware per model and simplified model orchestration.
San Jose Sharks Vs Carolina Hurricanes @ GTC
Join us in a private suite for the Hurricanes vs Sharks game during NVIDIA GTC.
NYC Tech Breakfast Club: ML Engineering Leaders
Tech Breakfast Club is teaming up with Baseten to host a Tech Breakfast Club for CTOs and machine learning leaders in New York.
Private, secure DeepSeek-R1 in production in US & EU data centers
Dedicated deployments of DeepSeek-R1 and DeepSeek-V3 offer private, secure, high-performance inference that's cheaper than OpenAI
