Skip to main content
Back to resources
Inference⚡

Flide

Released on Nov 10, 2026

Open-source inference engine for decision models (Jev family). The technique is exact state forking: multiple questions share computation while preserving exact decision semantics. The authors' tests claim up to 9.5x speed over vLLM and SGLang; supports 30+ open-source decision models (Decision Index 0.4.1).

Features

  • Exact state forking
  • Up to 9.5x faster (authors)
  • 30+ decision models
  • Open source

Tags

Useful links

Discover Flide

Visit the official site to download, learn more and start using Flide.

Visit the site

Related resources — Inference

Inference⚡
llama.cpp
Released Oct 15, 2022

C++ implementation of LLMs for efficient inference on consumer CPUs and GPUs.

LLMC++LocalEfficient
Inference🦙
Ollama
Released Jul 27, 2023v0.35.0

Open source tool to run LLMs locally with simplicity.

LLMLocalOpen SourceCLI
Inference🗣️
Piper TTS
Released Apr 1, 2022Piper

Sintesi vocale in locale a bassa latenza basata su ONNX: genera parlato naturale da testo in tempo quasi reale, anche su CPU. Multilingue (italiano incluso) e facile da integrare nei pipeline: download del modello, una riga di comando. MIT.

AudioTTSOpen SourceLocale