Skip to main content
← Back to news

Ollama brings local text-to-speech: 100x faster than real time on Apple Silicon

On-device & edge
Source:Ollama
Ollama's voice models read out loud with 100-200 ms Latency using Apple's Metal: on an NVIDIA GPU with CUDA, speed also exceeds 100x real time. Before a conversation, you can generate the System prompt line as audio, so the user doesn't have to wait on every message. Voice models are OpenAI-API-compatible and work with existing tools (Open WebUI, OpenCode, Claude Code).

Get the next local-AI briefing

Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.

After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.