Bonsai-2 27B: 27B ternary reasoning that runs on a laptop
Model releasesRelated articles
MiniCPM-V 4.7: the 35B MoE that runs on a smartphone with 3 GB of RAM
The first open 35B MoE (3B active) that runs fluidly on a smartphone: 13+ tok/s with 3 GB of RAM on an iPhone 17 Pro Max, OCR, video and a 21.8 GB GGUF Q4_K_M for desktop. The numbers, the three techniques, the limits.
QRAE: compressing DeepSearch agent context to save tokens and latency
QRAE uses the model's own attention entropy to decide which retrieved chunks stay in the context: tokens -45%, latency -30% and higher success across four benchmarks.
gpt-oss: OpenAI's open reasoning model
21B total parameters but only 3.6B active, native MXFP4 weights and 128K of context: OpenAI's first open reasoning model fits in 16GB. What that means in practice.
Get the next local-AI briefing
Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.
After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.

