Blog
Articles, guides, and insights on local artificial intelligence
3 articles found per "Hardware locale"

Mac Studio M5 Ultra: practical 512GB guide - models that fit and GGUF setup
What actually fits in the 512GB Mac Studio M5 Ultra: the 4-bit rule for MoE (active vs total params), three GGUF setup paths (Ollama, LM Studio, llama.cpp), why the KV cache is the real bottleneck, and when the $9,999 pays back against APIs.

Ling 3.1 Flash: 560B open-weight with MIT license and 1M context — what changes if you have 24GB of VRAM
inclusionAI's Ling 3.1 Flash: hybrid MoE 560B total / 25B active, native 1M-token context, FP8 checkpoint, MIT license. What it concretely means for 24GB of VRAM: quantizations, parallelism and API costs.

Aleph Alpha's Kolibri: the 78B MoE that runs (almost) locally
Aleph Alpha's Kolibri (78.1B/3.46B, Apache 2.0, FP8) is the European open-weight MoE: reasoning, tool calling and context up to 1M tokens. In FP8 it weighs ~78GB of VRAM: it runs on an RTX 5090 32GB + shared RAM or on unified-memory Macs; for practical adoption the kolibri1 architecture in llama.cpp and Ollama/LM Studio builds are still missing.

