AI Founders Dinner New York City
We're incredibly excited to bring together an elite group of NYC-based founders shaping the future of the AI space in the city and beyond.
Join us at 3-Michelin Star Per Se in Manhattan for a chance to meet, network and learn from your peer founders.
Operating under Chatham House Rules, there will be no sales pitches, only small-group discussions where founders can ask questions of peers and share experiences around building and scaling enduring companies.
Host
Baseten
NYC Tech Breakfast Club: ML Engineering Leaders
Join us for the NYC Tech Breakfast Club for ML Engineers
Driving model performance optimization: 2024 highlights
Baseten's model performance team works to optimize customer models for latency, throughput, quality, cost, features, and developer efficiency.
New observability features: activity logging, LLM metrics, and metrics dashboard customization
We added three new observability features for improved monitoring and debugging: an activity log, LLM metrics, and customizable metrics dashboards.
How we built production-ready speculative decoding with TensorRT-LLM
Our TensorRT-LLM Engine Builder now supports speculative decoding, which can improve LLM inference speeds.
A quick introduction to speculative decoding
Speculative decoding improves LLM inference latency by using a smaller model to generate draft tokens that the larger target model can accept during inference.
