Resources

Tools, frameworks, and models for local AI

All Organizations Hardware Software Models Inference Frameworks

Sort by:Name (A-Z)Name (Z-A)Category Newest first Oldest first Price (low to high)Price (high to low)VRAM (highest first)Parameters (largest first)

3 resources found for "ML"

Inference⚡

ML Drift

Google's open-source (Apache 2.0) on-device GPU inference engine, successor to the TensorFlow Lite GPU delegate: tensor virtualization, stage-aware KV cache for prefill and decode, FP16/INT8/INT4. Backends: OpenCL (Android), Metal (Apple), WebGPU via Dawn (browser), OpenGL ES 3.1+. Integrates with LiteRT; in production on Chrome, YouTube, Photos and Meet.

IA localeOn-deviceGPUOpen SourceGoogle

Learn more

CompareSite

Inference🔗

Replicate

Released Jun 1, 2022

API platform to run ML models without managing infrastructure.

APICloudMLServerless

Learn more

CompareSite

Inference🎙️

whisper.cpp

Released Mar 1, 2023whisper.cpp

Il port C/C++ ad alte prestazioni di Whisper: trascrizione vocale in locale ottimizzata per CPU e Apple Silicon, senza dipendenze da Python. Quantizzazione GGML (Q4_0–Q8_0) con riduzione fino al 65% a disco, streaming via whisper-stream, accelerazione Metal/Vulkan. MIT.

AudioTrascrizioneOpen SourceLocale

Learn more

CompareSite