Generally Available: The world's fastest and most accurate Whisper transcription

Return to model library

LLM

30 large language models

DeepSeek-V3

LLM

V3SGLangH200

Llama 3.3 70B Instruct

LLM

3.3TRT-LLMH100

Llama 3.1 70B Instruct

LLM

3.1InstructTRT-LLMH100

Qwen 2.5 7B Math Instruct

LLM

2.5MathTRT-LLMH100 MIG 40GB

Qwen 2.5 14B Instruct

LLM

2.5TRT-LLMH100

Qwen 2.5 32B Coder Instruct

LLM

2.5CoderTRT-LLMH100

Llama 3.1 8B Instruct

LLM

3.1InstructTRT-LLMH100

Optimized Llama 3 8B Instruct

Llama 3.1 Nemotron 70B

LLM

3.1NemotronA100

Llama 3.1 405B Instruct

LLM

3.1InstructH100

Ultravox v0.4

LLM

0.4vLLMH100 MIG 40GB

Llama 11B Vision

Llama 3.2 11B Vision Instruct

LLM

3.2VisionA100

Llama 3.2 90B Vision Instruct

LLM

3.2VisionH100

Llama 3 70B Instruct

LLM

3TRT-LLMH100

Prompt: Three llamas in a mountain

Llama 3 8B Instruct

LLM

3InstructTRT-LLMH100

Mistral 7B Instruct

LLM

v3TRT-LLMH100 MIG 40GB

Qwen 2.5 14B Coder Instruct

LLM

2.5CoderTRT-LLMH100

Qwen 2.5 7B Coder Instruct

LLM

2.5CoderTRT-LLMH100 MIG 40GB

Qwen 2.5 72B Math Instruct

LLM

2.5MathTRT-LLMH100

Qwen 2.5 72B Instruct

LLM

2.5TRT-LLMH100

Qwen 2.5 32B Instruct

LLM

2.5TRT-LLMH100

Qwen 2.5 7B Instruct

LLM

2.5TRT-LLMH100 MIG 40GB

Qwen 2.5 3B Instruct

LLM

2.5TRT-LLMA10G

Pixtral 12B

LLM

PixtralvLLMA100

Phi 3.5 Mini Instruct

LLM

3.5128kvLLMA10G

Gemma 2 9B

LLM

vLLMA100

gemma 27b

Gemma 2 27B

LLM

vLLMA100

Phi 3 Mini 128K Instruct

LLM

3128kT4

Phi 3 Mini 4K Instruct

LLM

34kT4

Mixtral 8x7B Instruct

LLM

v1TRT-LLMH100

Sail

Mixtral 8x22B

LLM

H100

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

Start deploying

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten 👋 👽

INFO

🚀 Uploading model to Baseten 🚀

Upload progress: 0% | | 0.00G/2.39G