Blog
Articles, guides, and insights on local artificial intelligence
5 articles found per "ollama"
Mac Studio M5 Ultra: practical 512GB guide - models that fit and GGUF setup
What actually fits in the 512GB Mac Studio M5 Ultra: the 4-bit rule for MoE (active vs total params), three GGUF setup paths (Ollama, LM Studio, llama.cpp), why the KV cache is the real bottleneck, and when the $9,999 pays back against APIs.
vLLM: serving models fast
vLLM is the open-source engine that turns a local model into a concurrent server: PagedAttention, continuous batching, installation and the key concepts for choosing when to use it instead of Ollama.
Open WebUI: the interface for your local AI
Open WebUI is the full web interface for your local models: Docker install, connecting Ollama, per-model customization, document RAG, and its honest limits.
Local AI on Mac: the complete Apple Silicon guide
Why Apple Silicon (unified memory, GPU cores) is the simplest machine for local AI: the RAM you need, installing Ollama, recommended models per chip generation, and realistic performance expectations.
Running LLM Models Locally: From First Install to First Working Model
Learn how to install and use large language models on your own computer, without relying on cloud services.