Baseten is now fully OpenAI compatible

The OpenAI SDK has become a standard for interacting with AI models, making it extremely important in the inference space. We’re happy to announce official OpenAI-compatible APIs for both chat completions and completions on models deployed to Baseten!

This takes our previous “OpenAI Bridge” to the next level with full, baked-in support for OpenAI-compatible models out of the box. Migrating existing client code is now simpler than ever: after updating the URL, both synchronous and streaming functionality will work immediately. Take a look at our examples in our model library to start using OpenAI-compatible models today.

✕