Customer stories
We're creating a platform for progressive AI companies to build their products in the fastest, most performant infrastructure available.
What our customers are saying
See all
Sahaj Garg,
Co-Founder and CTO
Inference for custom-built LLMs could be a major headache. Thanks to Baseten, we’re getting cost-effective high-performance model serving without any extra burden on our internal engineering teams. Instead, we get to focus our expertise on creating the best possible domain-specific LLMs for our customers.
We are constantly testing and iterating to build the best-in-class retrieval models. Baseten Training allows my team to focus fully on training without needing to worry about hardware and job orchestration. We moved all of our training jobs to Baseten so our researchers have more flexibility to build our foundational models. If we had this when we were first starting out it would have saved us a lot of time and headaches.
Antonio Scandurra,
Co-founder
We are constantly testing and iterating to build the best-in-class retrieval models. Baseten Training allows my team to focus fully on training without needing to worry about hardware and job orchestration. We moved all of our training jobs to Baseten so our researchers have more flexibility to build our foundational models. If we had this when we were first starting out it would have saved us a lot of time and headaches.
Customer Stories
Praktika delivers ultra-low-latency transcription for global language education with Baseten
With Baseten, Praktika delivers <300 milliseconds latency empowering leanguage learners worldwide with a seamless conversational and learning experience.
Read case studyWith Baseten, Praktika delivers <300 milliseconds latency empowering leanguage learners worldwide with a seamless conversational and learning experience.
Read case studyZed Industries serves 2x faster code completions with the Baseten Inference Stack
By partnering with Baseten, Zed achieved 45% lower latency, 3.6x higher throughput, and 100% uptime for their Edit Prediction feature.
Read case studyBy partnering with Baseten, Zed achieved 45% lower latency, 3.6x higher throughput, and 100% uptime for their Edit Prediction feature.
Read case study
Wispr Flow creates effortless voice dictation with Llama on Baseten
Wispr Flow runs fine-tuned Llama models with Baseten and AWS to provide seamless dictation across every application.
Read case studyWispr Flow runs fine-tuned Llama models with Baseten and AWS to provide seamless dictation across every application.
Read case studyRime serves speech synthesis API with stellar uptime using Baseten
Rime AI chose Baseten to serve its custom speech synthesis generative AI model and achieved state-of-the-art p99 latencies with 100% uptime in 2024
Read case studyRime AI chose Baseten to serve its custom speech synthesis generative AI model and achieved state-of-the-art p99 latencies with 100% uptime in 2024
Read case study
Baseten powers real-time translation tool toby to Product Hunt podium
The founders of toby worked with Baseten to deploy an optimized Whisper model on autoscaling hardware just one week ahead of their Product Hunt launch and had a top-three finish with zero downtime.
Read case studyThe founders of toby worked with Baseten to deploy an optimized Whisper model on autoscaling hardware just one week ahead of their Product Hunt launch and had a top-three finish with zero downtime.
Read case studyCustom medical and financial LLMs from Writer see 60% higher tokens per second with Baseten
Writer, the leading full-stack generative AI platform, launched new industry-specific LLMs for medicine and finance. Using TensorRT-LLM on Baseten, they increased their tokens per second by 60%.
Read case studyWriter, the leading full-stack generative AI platform, launched new industry-specific LLMs for medicine and finance. Using TensorRT-LLM on Baseten, they increased their tokens per second by 60%.
Read case studyPatreon saves nearly $600k/year in ML resources with Baseten
With Baseten, Patreon deployed and scaled the open-source foundation model Whisper at record speed without hiring an in-house ML infra team.
Read case studyWith Baseten, Patreon deployed and scaled the open-source foundation model Whisper at record speed without hiring an in-house ML infra team.
Read case study