← Back to news30 September 2026

Magnitude: an open-source inference engine that optimizes itself

Launched on Hacker News (YC S25), Magnitude is a Rust Inference engine that compiles and tunes its kernels directly on your target hardware. On open models it claims up to 2× the speed of llama.cpp, on Apple Silicon, NVIDIA, AMD or CPU. Verified against the official repository.

Read original article

Intel and AMD collaborate on PyTorch/oneDNN: what it means for local AI on CPUs

AMD is merging ZenDNN into oneDNN and Intel is folding in its ACE extensions: one open-source x86 acceleration stack in PyTorch, already the default. What it changes if you run models locally on CPUs.

GPU or CPU: when the CPU is enough

Do you really need a GPU for local AI? For many use cases, no: how prefill and decode work, what matters (memory bandwidth), real numbers on a mainstream laptop, the cases where the CPU is enough and where VRAM is needed — with the commands to measure on your own hardware.

ML Drift: Google's open-source on-device GPU engine, and when it beats the generalists

The engine that runs models inside Chrome and YouTube is now open source: architecture, benchmark numbers, and an honest comparison with Ollama and llama.cpp.

Get the next local-AI briefing

Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.

Newsletter language

I consent to the processing of my data to receive the iaLocale newsletter. Read the Privacy Policy.

After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.

Related resources

Tools and resources from the iaLocale archive relevant to this content.

⚡

Magnitude

Inference

Open-source inference engine (Rust, YC S25) that compiles and tunes its kernels directly on the target hardware: Apple Silicon, NVIDIA, AMD or CPU. On open models it claims up to 2× the speed of llama.cpp. Also aimed at serving agents.

🖥️