A 10 year old Xeon is all you need

banner.ebd2671bea295a74

Published on June 01, 2026A 10 year old Xeon is all you need17 minutes readThe previous post covered getting Gemma 4’s MTP drafters quantized and paired with a verifier. This one is about running the result on a machine that has no business running it.I have a recycled server. To its credit, it has a whopping 128 GB RAM, but it’s DDR3… That RAM is 5-6 times slower than the current best laptop ram. It also has a single Intel Xeon E5-2620 v4 from 2016, which is about 5 times slower than my laptops CPU…Oh, and as I did mention, we have no GPU. And no, the Xeon does not have an integrated GPU.But, just hear me out…If we were to just break out ollama here, well… as explained in earlier blog posts, we can’t. And we’d be lucky if we could in 6 months when they add support for…

Continue reading at Hacker News point.free
Advertisement