Inference⚡
llama.cpp
Released Oct 15, 2022
C++ implementation of LLMs for efficient inference on consumer CPUs and GPUs.
LLMC++LocalEfficient
Released on Nov 10, 2026
Open source inference engine for Apple Silicon built on Metal: claims decode up to three times faster than classic engines on MacBook and Mac Studio. Young project, no independent benchmarks yet.
Visit the official site to download, learn more and start using Tokspur.
C++ implementation of LLMs for efficient inference on consumer CPUs and GPUs.
Open source tool to run LLMs locally with simplicity.
Sintesi vocale in locale a bassa latenza basata su ONNX: genera parlato naturale da testo in tempo quasi reale, anche su CPU. Multilingue (italiano incluso) e facile da integrare nei pipeline: download del modello, una riga di comando. MIT.