Chains Launch Party
Baseten just released Chains, a new SDK and framework for compound AI configurations allowing engineers to link multiple ML models + tasks without sacrificing GPU utilization and performance.
We're insanely proud of the workflows that Chains unlocks for ML teams of every size, from AI agent startups to multinationals prioritizing security, compliance, and market adaptability.
Join us to celebrate our new launch with an open bar for ML engineers and team leads.
Don't hesitate to reach us with any questions at hi@baseten.co.
Host
Julien Reiman
AI Tinkerers NYC October Meetup
Join us for an exciting evening of hands-on demos, talks, and networking at the AI Tinkerers October meetup!
NYC Tech Breakfast Club: ML Engineering Leaders
If you're an AI leader in NYC, join us for a hearty breakfast and good conversation!
Few-shot Happy Hour (SF Tech Week)
Come join us for a happy hour with the most cracked AI engineers, founders, and investors in the Bay.
Building Compound AI with Baseten Chains (SF Tech Week)
Join us for a presentation about building compound AI for next-generation AI products, followed by a happy hour!
How to build function calling and JSON mode for open-source and fine-tuned LLMs
Use a state machine to generate token masks for logit biasing to enable function calling and structured output at the model server level.
Export your model inference metrics to your favorite observability tool
Export model inference metrics like response time and hardware utilization to observability platforms like Grafana, New Relic, Datadog, and Prometheus.
How to build function calling and JSON mode for LLMs
In this webinar we'll dive deep into how to implement function calling and JSON mode for LLMs: defining schemas and tools, building a state machine, and more.
Baseten partners with Google Cloud to deliver high-performance AI infrastructure to a broader audience
Baseten is now on Google Cloud Marketplace, empowering organizations with the tools to build and scale AI applications effortlessly.
Introducing Baseten Hybrid: control and flexibility in your cloud and ours
Baseten Hybrid is a multi-cloud solution that enables you to run inference in your cloud—with optional spillover into ours.
Where to run your inference workloads
Read our white paper on how to choose a hosting option for AI model inference comparing cloud, self-hosted, and hybrid deployment options.
