"Inference Engineering" is now available. Get your copy here
Blog

Inference Engineering

AllResearchModel performanceAI engineeringInfrastructureNewsCommunityAI modelsProductFoundations
AI engineering

GPT vs Llama: Migrate to open source LLMs seamlessly

Sid Shanker
1 other
From GPT to llama
AI engineering

Open source alternatives for machine learning models

Varun Shenoy
1 other
Open source AI models
AI engineering

A checklist for switching to open source ML models

Philip Kiely
OSS checklist
Model performance

A guide to LLM inference and performance

Varun Shenoy
1 other
LLM performance
Infrastructure

Pinning ML model revisions for compatibility and security

Philip Kiely
Pin revisions for security
AI engineering

Deployment and inference for open source text embedding models

Philip Kiely
Deploy and use open-source text embedding models
Infrastructure

NVIDIA A10 vs A100 GPUs for LLM and Stable Diffusion inference

Philip Kiely
A10 vs A100
Model performance

SDXL inference in under 2 seconds: the ultimate guide to Stable Diffusion optimization

Varun Shenoy
1 other
SDXL in under 2 seconds
AI engineering

Build your own open-source ChatGPT with Llama 2 and Chainlit

Philip Kiely
Build your own ChatGPT
1...1718192021