Skip to content

Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents

8.2 relevance
Score Breakdown
technical depth
8
novelty
9
actionability
7
community
8
strategic
8
personal
10

Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.

Launch of a self-optimizing inference engine for agents, perfectly matching the reader's AI orchestration focus.

AI/ML github.com
Open source inference engine for agents that optimizes itself for your exact hardware. Compiles and tunes its kernels on your device, so open models run up to 2x faster than llama.cpp. Works on App...
Summary

Hey HN, Anders and Tom here. We're building Magnitude, an inference engine for agents that optimizes itself to run as fast as possible on your hardware. It works on Mac, Linux, and Windows on any hardware and is up to 2x faster than llama.cpp. We're both software engineers and previously built an open source browser agent to 4k+ GH stars and 100k+ downloads. We increasingly wanted to run it on local models, but found that no inference engine worked for our use case. Inference engines today all m

Author

magnitudedev