Skip to main content

Blog

Articles, guides, and insights on local artificial intelligence

6 articles found per "GGUF"

Where local models learn: open weights explained without the fluff
FundamentalsBeginner

Where local models learn: open weights explained without the fluff

The model doesn't hook into the internet for its abilities: it absorbed them once at pre-training and executes them on your hardware. Open weights isn't open data, and the models come from many labs, not one.

iaLocale Team
October 27, 2026
MagpieTTS 357M: 12-language speech synthesis that runs on a laptop
Use casesBeginner

MagpieTTS 357M: 12-language speech synthesis that runs on a laptop

NVIDIA releases MagpieTTS Multilingual, 364M parameters and 12 languages in one model: local text-to-speech with a 332 MB GGUF file, no GPU. The C++ runtime NeMo-Speech.cpp takes you from zero to first audio in three commands; the five voices are the same in every language, and for a natively Italian voice Piper is still ahead.

iaLocale Team
October 22, 2026
MiniCPM-V 4.7: the 35B MoE that runs on a smartphone with 3 GB of RAM
ModelsIntermediate

MiniCPM-V 4.7: the 35B MoE that runs on a smartphone with 3 GB of RAM

MiniCPM-V 4.7 (35B total, ~3B active, released October 12, 2026 by OpenBMB and ModelBest) is the first open MoE in the series, vision-language: multiple images, video, OCR. 13+ tok/s with 3 GB of RAM on an iPhone 17 Pro Max, 17+ on Android. Official quantizations BF16, FP8, INT4, AWQ, GPTQ, GGUF; engines Ollama, llama.cpp, vLLM, SGLang. The three techniques: Lookahead Expert Scheduling, fine per-level quantization, DSpark speculative sampling.

iaLocale Team
October 21, 2026
Mac Studio M5 Ultra: practical 512GB guide - models that fit and GGUF setup
GuidesAdvanced

Mac Studio M5 Ultra: practical 512GB guide - models that fit and GGUF setup

What actually fits in the 512GB Mac Studio M5 Ultra: the 4-bit rule for MoE (active vs total params), three GGUF setup paths (Ollama, LM Studio, llama.cpp), why the KV cache is the real bottleneck, and when the $9,999 pays back against APIs.

iaLocale Team
October 20, 2026
GGUF: The Format That Keeps Models on Your Hardware
ModelsIntermediate

GGUF: The Format That Keeps Models on Your Hardware

GGUF is the single-file format that ships models for local inference: a header with a signature and version, key-value metadata, a tensor index, and weights aligned for fast mmap loading. Quantization types with real sizes (8B from 14.96 GiB at F16 to 4.58 GiB at Q4_K_M), the filename convention, and the rule for picking a size against your VRAM or RAM.

iaLocale Team
September 30, 2026
Quantization: Get More From the Same Hardware
ModelsIntermediate

Quantization: Get More From the Same Hardware

Quantization reduces the precision of the weights (from FP16 to 4–8 bit) so models fit in less VRAM and generate more tokens per second. The levels, the real file sizes of Qwen2.5 14B, the rule for choosing from Q4_K_M, and the limits (code, reasoning, languages other than English).

iaLocale Team
September 28, 2026