CUDA

Compute Unified Device Architecture: NVIDIA's GPU programming stack — libraries, compiler and runtime that run model inference on NVIDIA GPUs. It is the default backend for Ollama and llama.cpp on NVIDIA hardware: optimizations (Flash Attention, quantized kernels, FP4 formats) arrive on CUDA first.