Hacker News

Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents

Monzo's pivot from cool to corporate: 'Freshness is not about ...

Magnitude Run open models as fast as your hardware allows Magnitude is an open source inference engine for agents that optimizes itself for your exact hardware. It compiles and tunes its kernels on your device, so open models run up to 2x faster than llama.cpp. One click connects the agent you already use (Pi, OpenCode, Hermes, Codex, and more). Works on Apple Silicon, NVIDIA, AMD, or nothing but a CPU. Download Magnitude for macOS, Windows, or Linux ⭐ Help us reach more developers and grow the Magnitude community. Star this repo! demo-9-29.mp4 Get started Download Magnitude, install it, and open the app. Choose a recommended model in Discover and download it. Connect your agent in Connections and start using it. The desktop app includes the magnitude CLI. No…

Continue reading at Hacker News github.com
Advertisement