Blog
Articles, guides, and insights on local artificial intelligence
10 articles found per "api"

Ollama voice: local speech synthesis, from the command line to the OpenAI API
Phonon brings speech synthesis to the Ollama server: one command to speak, an OpenAI-compatible endpoint and streaming read-aloud of the reply, 35% faster than the reference runtime on M5 Max.

SynthAPI: synthetic environments and scaling laws for training tool-use agents
Controlled synthetic environments with failures on a dial to train local tool-use agents: SynthAPI's scaling laws and the math — ~€1.60 of energy vs ~€158 of API for 10,000 tasks.

Secret Guard and local LLM gateways: protecting secrets while your agent uses them
Secret Guard is a Rust, open-source gateway that intercepts your agent's requests and swaps secrets for mocks before they reach the provider: the model never sees them, and the real value comes back to the agent.

Local Images: ComfyUI 0.40 and comfy_attention — new for all models
ComfyUI 0.40 extends comfy_attention to all models with per-model selectable kernels and LoRA override, turns on the asset system by default with a local API, and standardizes 3D output; the VRAM table stays the choice reference.

ML agents that run locally: MLExpert and EpochGo on Ollama, zero API costs
MLExpert raises the bar to 35B and a 72.7% medal rate; EpochGo runs three AutoML agents on 16 GB at zero API cost: what works today, the math and the limits.

Mac Studio M5 Ultra: practical 512GB guide - models that fit and GGUF setup
What actually fits in the 512GB Mac Studio M5 Ultra: the 4-bit rule for MoE (active vs total params), three GGUF setup paths (Ollama, LM Studio, llama.cpp), why the KV cache is the real bottleneck, and when the $9,999 pays back against APIs.

Ling 3.1 Flash: 560B open-weight with MIT license and 1M context — what changes if you have 24GB of VRAM
inclusionAI's Ling 3.1 Flash: hybrid MoE 560B total / 25B active, native 1M-token context, FP8 checkpoint, MIT license. What it concretely means for 24GB of VRAM: quantizations, parallelism and API costs.

What a token costs: five routes, the math, and the break-even point
Frontier API, subscription, inference providers, rented GPU or your own hardware: five routes to tokens, with real monthly costs, the electricity bill, and the calculated break-even point.

Costs: local vs API, done with real numbers
How much does local really cost compared to a cloud API? Verified per-token prices, GPU amortization, electricity and the break-even point, calculated with real numbers.

Ollama vs LM Studio: Which Tool to Choose
Ollama for servers and scripts, LM Studio for desktop exploration: the comparison table, the two APIs (11434/1234) and the real case of using both.

