Configure your model resources
By default, models deployed on Baseten run on a single instance with 1 vCPU and 2 GiB of RAM. This instance size is sufficient for some models and workloads, but demanding models and high-traffic...
Changelog | Page 9
See our latest feature releases, product improvements and bug fixes
Dec 23, 2022
Dec 13, 2022
Enable live reload with draft models
Slow dev loops break flow state and make for a frustrating experience. And for data scientists, slow dev loops make all but the most essential deployment workflows too expensive and time consuming to...
Nov 29, 2022
Weekly round-up: Deploy Flan-T5 XL on Baseten
Flan-T5 XL is an open-source large language model developed by Google. Flan-T5 is an instruction-tuned model, meaning that it exhibits zero-shot-like behavior when given instructions as part of the...
Nov 15, 2022
Weekly round-up: Live reload Truss in Docker dev environment
The latest release of Truss, version 0.1.5 , introduces a live reload mechanic to improve developer velocity when working with Docker. Docker is great because it makes your development environment...
Nov 8, 2022
Weekly round-up: Python environment per application
Until today, applications on your Baseten account shared a single Python environment. Now, you can install Python packages from PyPi or system packages like ffmpeg on an app-by-app basis. What’s...
Nov 3, 2022
Special issue: Deploy MLflow models on Baseten
Baseten now supports MLflow models via Truss. MLflow is a popular library for model experimentation and model management with over ten million monthly downloads on PyPi. With MLflow, you can train a...
Nov 2, 2022
Special issue: Use Stable Diffusion instantly as an API
What if instead of painstakingly configuring Stable Diffusion to run locally or paying for expensive cloud GPUs, you could deploy it in a couple of clicks? And better still, it would be instantly...
Oct 26, 2022
Weekly round-up: Wait less. Build more!
Explore models with guidance Often, the hardest part of a project is getting started. And when you’re getting started with an unfamiliar model, there are a few things you want to do: try it on a...
Oct 18, 2022
Weekly round-up: Deploy OpenAI Whisper instantly
We added Whisper, a best-in-class speech-to-text model, to our library of pre-trained models. That means you can deploy Whisper instantly on your Baseten account and build applications powered by the...
Oct 12, 2022
Weekly round-up: Select multiple components in the view builder
In the view builder, you can now select multiple components at the same time and move them as a single block. You can also bulk duplicate and bulk delete multiple selected components. To select...
