Skip to main content
← Back to news

Flide: the open-source inference engine for decision models, up to 9.5x faster

Tools & releases
OmniJev releases Flide, an open-source inference engine for Jev-like decision models. The technique is exact state forking, which shares computation across multiple questions while preserving decision semantics: the tests claim up to 9.5x versus vLLM and SGLang, with 30+ open-source decision models supported (Decision Index 0.4.1).

Get the next local-AI briefing

Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.

After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.