Introducing the Baseten Frontier Gateway. Learn more here
Blog

Inference engineering

AllResearchModel performanceAI engineeringInfrastructureNewsCommunityAI modelsProductFoundations
Product

Introducing the Baseten Frontier Gateway

Bola Malek
1 other
Baseten Frontier Gateway
AI models

NVIDIA Nemotron 3 Nano Omni: Build multimodal agents on Baseten

Madison Kanna
nemotron 3 nano omni collage
Infrastructure

How we built RBAC that scales for the enterprise

Matt Howard
2 others
How Baseten built RBAC that scales for the enterprise
AI engineering

Harnesses are everything. Here's how to optimize yours.

Alex Ker
1 other
Three things you can do right now to optimize your harness
Model performance

How to train custom EAGLE-3 heads for speculative decoding

Model Performance Team
eagle 3
Infrastructure

How the Baseten Delivery Network (BDN) makes cold starts fast

Gregory Kofman
2 others
How the Baseten Delivery Network (BDN) makes cold starts fast
Model performance

Sub-3 millisecond named entity recognition (NER) inference

Michael Feil
1 other
Sub-3 millisecond named entity recognition (NER) inference
Research

Towards infinite context windows: neural KV cache compaction

Charles O'Neill
2 others
2
Foundations

Open-source LLM training is a mess. Here is how it all works.

Paras Stefanopoulos
1
123...22