ggml

The C/C++ tensor library that llama.cpp is built on (named after GGML, the format that made it famous). It defines tensors, operations and backends — CPU, GPU, Apple Silicon — on which models run in local inference. It is the hardware layer of the inference stack: runtimes like Ollama and llama.cpp sit on top of it.