Truss' latest update addresses key ML model serving issues. Discover how to speed up SDXL inference to 3s and build ChatGPT-like apps with Llama 2 & Chainlit.
Llama 2 and SDXL shake up foundation model leaderboards (plus: Langchain, autoscaling, and more)
AI infrastructure, ML infrastructure, build vs. buy, model deployment
Explore open source foundation models: Llama 2 (Meta/Microsoft), FreeWilly1/2, SDXL 1.0 (Stability AI), LayoutLM (Inspira), NSQL 350M (Number Station).
Dive into open source foundation models, focusing on LLMs: Falcon-7B/40B, WizardLM, MusicGen (Meta), MPT-7B (Mosaic).
LangChain adds Baseten integration, Falcon soars to the top of the LLM leaderboard
Explore new text generation and text-to-speech models, their GPU requirements, and join the community around open-source models.
LLMs go OSS, AI community thrives, Baseten offers free credits to start deploying models