Local model won't stop talking? The fault is often the chat template
Tools & releasesRelated articles
GGUF: The Format That Keeps Models on Your Hardware
We open the box: what's really inside a .gguf file, why it's a single file, how to read the filename, and how to pick the size for your VRAM, with the real sizes of an 8B model.
Where local models learn: open weights explained without the fluff
The model doesn't hook into the internet for its abilities: it absorbed them once at pre-training and executes them on your hardware. Open weights isn't open data, and the models come from many labs, not one.
Decision models in local: JEV-35B and the 3B-active System 1
You don't need a big LLM to decide. JEV-35B (35B, 3B active) in NVFP4 on a 32GB GPU and ej (11.4MB) on CPU show how to do routing, classification and quality control without generating a single token.
Get the next local-AI briefing
Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.
After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.