Inference

The process of using a trained model to generate responses or make predictions on new data. In local AI, inference runs on your computer instead of remote servers. This ensures privacy and consistent response times without relying on internet connections.