Gemma 3 27B IT

LLM VLLM H100

Instruct-tuned open model by Google with excellent ELO/size tradeoff and vision capabilities

Deploy Gemma 3 27B IT behind an API endpoint in seconds.

Deploy model

Example usage

Gemma 3 is an OpenAI-compatible model and can be called using the OpenAI SDK in any language.

Input

1from openai import OpenAI
2import os
3
4model_url = "" # Copy in from API pane in Baseten model dashboard
5
6client = OpenAI(
7    api_key=os.environ['BASETEN_API_KEY'],
8    base_url=model_url
9)
10
11# Chat completion
12response_chat = client.chat.completions.create(
13    model="",
14    messages=[{
15        "role": "user",
16        "content": [
17            {"type": "text", "text": "What's in this image?"},
18            {
19                "type": "image_url",
20                "image_url": {
21                    "url": "https://picsum.photos/id/237/200/300",
22                },
23            },
24        ],
25    }],
26    temperature=0.3,
27    max_tokens=512,
28)
29print(response_chat)

JSON output

1{
2    "id": "143",
3    "choices": [
4        {
5            "finish_reason": "stop",
6            "index": 0,
7            "logprobs": null,
8            "message": {
9                "content": "[Model output here]",
10                "role": "assistant",
11                "audio": null,
12                "function_call": null,
13                "tool_calls": null
14            }
15        }
16    ],
17    "created": 1741224586,
18    "model": "",
19    "object": "chat.completion",
20    "service_tier": null,
21    "system_fingerprint": null,
22    "usage": {
23        "completion_tokens": 145,
24        "prompt_tokens": 38,
25        "total_tokens": 183,
26        "completion_tokens_details": null,
27        "prompt_tokens_details": null
28    }
29}

Preview

Example usage

Deploy any model in just a few commands