Book a demo at AWS re:Invent (booth 1522) to receive our famous "Artificially Intelligent" sweatshirt!

Model library

Browse our library of open source models that are ready to deploy behind an API endpoint in seconds.

Deploy your own model

LLM Audio transcription Text to speech Image generation Audio generation Text embeddings Image to video Image classification Image processing

large language models

Llama 3.1 70B Instruct

LLM

3.1InstructTRT-LLMH100

Qwen 2.5 7B Math Instruct

LLM

2.5MathTRT-LLMH100 MIG 40GB

Qwen 2.5 14B Instruct

LLM

2.5TRT-LLMH100

Qwen 2.5 32B Coder Instruct

LLM

2.5CoderTRT-LLMH100

Llama 3.1 8B Instruct

LLM

3.1InstructTRT-LLMH100

Optimized Llama 3 8B Instruct

Llama 3.1 Nemotron 70B

LLM

3.1NemotronA100

audio transcription models

Whisper (best performance)

Audio transcription

V3H100 MIG 40GB

Whisper V3

Audio transcription

V3H100 MIG 40GB

Whisper V3 Turbo

Audio transcription

V3TurboH100 MIG 40GB

image generation models

Prompt: A movie still of an astronaut with a dark visor with a lightning bolt superhero icon on his chest

SDXL Lightning

Image generation

1.0LightningA100

moss covered astronaut

Stable Diffusion 3 Medium

Image generation

3A100

Stable Diffusion XL

Image generation

XL 1.0A10G

flux-dev

Image generation

devbloat16H100 MIG 40GB

flux-schnell

Image generation

schnellbfloat16H100 MIG 40GB

Comfy UI

Image generation

A10G

text embeddings models

Prompt: A movie still of a squirrel in a forest green ski suit

Nomic Embed v1.5

Text embeddings

v1.5T4

All MPNet Base V2

Text embeddings

v2CPU

All MiniLM L6 v2

Text embeddings

v2CPU

Jina Embeddings V2 Base EN

Text embeddings

V2ENCPU

audio generation models

Prompt: a cyberpunk movie still of a robot DJ at a club. Model: Playground 2.

AudioGen Medium

Audio generation

A10G

MusicGen Melody

Audio generation

MelodyA10G

MusicGen Large

Audio generation

MusicA10G

Meta models

Llama 3.1 70B Instruct

LLM

3.1InstructTRT-LLMH100

Llama 3.1 8B Instruct

LLM

3.1InstructTRT-LLMH100

Llama 3.2 90B Vision Instruct

LLM

3.2VisionA100

Llama 3.1 405B Instruct

LLM

3.1InstructH100

Llama 11B Vision

Llama 3.2 11B Vision Instruct

LLM

3.2VisionA100

Llama 3 70B Instruct

LLM

3TRT-LLMH100

Stability AI models

moss covered astronaut

Stable Diffusion 3 Medium

Image generation

3A100

Stable Diffusion XL

Image generation

XL 1.0A10G

Stable Video Diffusion

Image to video

Video 1.0A100

Comfy UI

Image generation

A10G

SDXL ControlNet Canny

Image generation

XL 1.0ControlNet - CannyA10G

SDXL ControlNet Depth

Image generation

XL 1.0ControlNet - DepthA10G

Mistral AI models

Mistral 7B Instruct

LLM

v3TRT-LLMH100 MIG 40GB

Pixtral 12B

LLM

PixtralvLLMA100

Mixtral 8x7B Instruct

LLM

v1TRT-LLMH100

Sail

Mixtral 8x22B

LLM

H100

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

Start deploying

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten 👋 👽

INFO

🚀 Uploading model to Baseten 🚀

Upload progress: 0% | | 0.00G/2.39G