Skip to main content

Blog

Articles, guides, and insights on local artificial intelligence

4 articles found per "inferenza"

Mac Studio M5 Ultra: 512GB of unified memory on the desktop
HardwareIntermediate

Mac Studio M5 Ultra: 512GB of unified memory on the desktop

Four dies, 512GB of unified memory at 1.2 TB/s: the Mac Studio M5 Ultra runs 100-560B MoE models locally. The speed math, the cost comparison with the DGX Station, and when the Mac is the right choice.

iaLocale Team
October 16, 2026
The 16GB Blackwell cards: 5060 Ti, 5070, 5070 Ti
HardwareIntermediate

The 16GB Blackwell cards: 5060 Ti, 5070, 5070 Ti

The 16GB VRAM tier is the center of gravity of local AI in 2026. It's enough memory to run the best open dense models in Q4 formats — the 27B class, the new balance point of the open catalog — without giving up too much context, and a list price that (depending on the month) stays within a personal budget. The Blackwell generation offers three cards exactly in the middle of this tier: the RTX 5060 Ti, 5070 and 5070 Ti. Same generation, same GDDR7, three very different experiences. Here's how they compare: what each one really brings you, and where your budget should go.

iaLocale Team
October 13, 2026
A Model Without a GPU: When the CPU Is Actually Enough
HardwareIntermediate

A Model Without a GPU: When the CPU Is Actually Enough

In 2026, CPU-only inference is no longer a fallback: when it genuinely works, what speed to expect, and which levers to pull to squeeze the most out of your processor.

iaLocale Team
October 2, 2026
GPU or CPU: when the CPU is enough
HardwareIntermediate

GPU or CPU: when the CPU is enough

How prefill and decode work, what matters for speed (memory bandwidth), real numbers on a mainstream laptop, the cases where the CPU is enough and where VRAM is needed — with the commands to measure.

iaLocale Team
September 21, 2026