Blog
Articles, guides, and insights on local artificial intelligence
6 articles found per "cpu"

Intel and AMD collaborate on PyTorch/oneDNN: what it means for local AI on CPUs
AMD is merging ZenDNN into oneDNN and Intel is folding in its ACE extensions: one open-source x86 acceleration stack in PyTorch, already the default. What it changes if you run models locally on CPUs.

Decision models in local: JEV-35B and the 3B-active System 1
You don't need a big LLM to decide. JEV-35B (35B, 3B active) in NVFP4 on a 32GB GPU and ej (11.4MB) on CPU show how to do routing, classification and quality control without generating a single token.

Unified memory: from Strix Halo to Mac Studio M5 Ultra — what fits and at what speed
128GB or 512GB of memory shared between CPU and GPU: three real platforms, the bandwidth that determines speed, and the math on what fits and for whom it makes sense.

A Model Without a GPU: When the CPU Is Actually Enough
In 2026, CPU-only inference is no longer a fallback: when it genuinely works, what speed to expect, and which levers to pull to squeeze the most out of your processor.

GPU or CPU: when the CPU is enough
How prefill and decode work, what matters for speed (memory bandwidth), real numbers on a mainstream laptop, the cases where the CPU is enough and where VRAM is needed — with the commands to measure.

Hardware for Local AI: What You Need in 2026
The memory rule (weights + KV cache), real October 2026 prices for GPUs, Apple Silicon and CPU, the 36-month cost math and the choice by budget.

