Book a demo at AWS re:Invent (booth 1522) to receive our famous "Artificially Intelligent" sweatshirt!

Model library / Qwen

Qwen

Family of LLMs built by Alibaba cloud

Qwen models

Qwen 2.5 7B Math Instruct

LLM

2.5MathTRT-LLMH100 MIG 40GB

Qwen 2.5 14B Instruct

LLM

2.5TRT-LLMH100

Qwen 2.5 32B Coder Instruct

LLM

2.5CoderTRT-LLMH100

Qwen 2.5 14B Coder Instruct

LLM

2.5CoderTRT-LLMH100

Qwen 2.5 7B Coder Instruct

LLM

2.5CoderTRT-LLMH100 MIG 40GB

Qwen 2.5 72B Math Instruct

LLM

2.5MathTRT-LLMH100

Qwen 2.5 72B Instruct

LLM

2.5TRT-LLMH100

Qwen 2.5 32B Instruct

LLM

2.5TRT-LLMH100

Qwen 2.5 7B Instruct

LLM

2.5TRT-LLMH100 MIG 40GB

Qwen 2.5 3B Instruct

LLM

2.5TRT-LLMA10G

Qwen VL

Qwen VL

Image classification

Image generation

A10G

LLM Developer

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

Start deploying

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten 👋 👽

INFO

🚀 Uploading model to Baseten 🚀

Upload progress: 0% | | 0.00G/2.39G