Hot French startup ZML releases free product to speed inference across lots of AI chips
7.9 relevance
Score Breakdown
technical depth 8
novelty 9
actionability 7
community 6
strategic 8
personal 9
Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.
Free software to speed AI inference across chips is highly technical, novel, and actionable for AI infrastructure.
Summary
ZML, a Paris-based startup backed by Yann LeCun and led by former Zenly VP Steeve Morin, launched ZML/LLMD, a free inference server that runs LLMs at peak performance across Nvidia, AMD, Google TPU, Apple Metal, and Intel Arc. Targeting the inference gold rush, the software aims to break vendor lock-in and reduce AI costs by enabling heterogeneous chip usage. ZML raised $20M and competes with Baseten, vLLM, and SGLang, while planning future monetization based on usage data.