The days of Nvidia’s unparalleled market dominance aren’t over, but challengers and choices are arising from all directions. ZML, a hot French AI startup endorsed by Turing Award winner Yann LeCun, has released inference-performance software that allows a variety of open-source large language models to run on a variety of chips — including Nvidia’s, AMD’s, Google’s TPU, Apple Metal and Intel Arc. With ZML/LLMD, the newly launched LLM inference server, the company’s ambition is to break existing silos and make different chips available for AI use cases at their maximum available speed, and sometimes faster, ZML founder Steeve Morin told TechCrunch. As AI becomes integrated into our work and everyday lives, optimizing inference — aka, the processing of prompts…
Hot French startup ZML releases free product to speed inference across lots of AI chips
Advertisement