Inference⚡
ML Drift
Google's open-source (Apache 2.0) on-device GPU inference engine, successor to the TensorFlow Lite GPU delegate: tensor virtualization, stage-aware KV cache for prefill and decode, FP16/INT8/INT4. Backends: OpenCL (Android), Metal (Apple), WebGPU via Dawn (browser), OpenGL ES 3.1+. Integrates with LiteRT; in production on Chrome, YouTube, Photos and Meet.
IA localeOn-deviceGPUOpen SourceGoogle

