Blog
Articles, guides, and insights on local artificial intelligence
2 articles found per "MoE"

ModelsAdvanced
Qwen3.8-2.4T-A95B: the math of running 2.4T open-weight parameters, 95B active
The first Qwen-Max-class open-weight model (2.4T parameters, 95B active) outgrows any consumer node: the math on weights, multi-node hardware, 36-month amortization, and power costs, and when running it locally makes sense.
iaLocale TeamNovember 22, 2026

GuidesAdvanced
Mac Studio M5 Ultra: practical 512GB guide - models that fit and GGUF setup
What actually fits in the 512GB Mac Studio M5 Ultra: the 4-bit rule for MoE (active vs total params), three GGUF setup paths (Ollama, LM Studio, llama.cpp), why the KV cache is the real bottleneck, and when the $9,999 pays back against APIs.
iaLocale TeamOctober 20, 2026

