Blog
Articles, guides, and insights on local artificial intelligence
2 articles found per "qwen"

FundamentalsIntermediate
Speculative decoding and MTP: speed for free
Speculative decoding makes local AI faster without changing output quality: a small model drafts the tokens, the big model verifies them. Here's how the draft-verify loop works, MTP heads in Qwen models, EAGLE on Mistral Medium 3.5, and how to enable it all in three commands.
iaLocale TeamOctober 12, 2026

FundamentalsIntermediate
KV cache: why your RAM needs more than just the model
What the KV cache is, the formula to calculate it with real numbers from Llama 3.1 8B and Qwen3 8B, and the three levers to manage it: context, quantization and flash attention.
iaLocale TeamOctober 1, 2026

