Skip to main content

Blog

Articles, guides, and insights on local artificial intelligence

6 articles found per "cpu"

Intel and AMD collaborate on PyTorch/oneDNN: what it means for local AI on CPUs
HardwareIntermediate

Intel and AMD collaborate on PyTorch/oneDNN: what it means for local AI on CPUs

AMD is merging ZenDNN into oneDNN and Intel is folding in its ACE extensions: one open-source x86 acceleration stack in PyTorch, already the default. What it changes if you run models locally on CPUs.

iaLocale Team
October 25, 2026
Decision models in local: JEV-35B and the 3B-active System 1
Use casesIntermediate

Decision models in local: JEV-35B and the 3B-active System 1

You don't need a big LLM to decide. JEV-35B (35B, 3B active) in NVFP4 on a 32GB GPU and ej (11.4MB) on CPU show how to do routing, classification and quality control without generating a single token.

iaLocale Team
October 17, 2026
Unified memory: from Strix Halo to Mac Studio M5 Ultra — what fits and at what speed
HardwareIntermediate

Unified memory: from Strix Halo to Mac Studio M5 Ultra — what fits and at what speed

128GB or 512GB of memory shared between CPU and GPU: three real platforms, the bandwidth that determines speed, and the math on what fits and for whom it makes sense.

iaLocale Team
October 10, 2026
A Model Without a GPU: When the CPU Is Actually Enough
HardwareIntermediate

A Model Without a GPU: When the CPU Is Actually Enough

In 2026, CPU-only inference is no longer a fallback: when it genuinely works, what speed to expect, and which levers to pull to squeeze the most out of your processor.

iaLocale Team
October 2, 2026
GPU or CPU: when the CPU is enough
HardwareIntermediate

GPU or CPU: when the CPU is enough

How prefill and decode work, what matters for speed (memory bandwidth), real numbers on a mainstream laptop, the cases where the CPU is enough and where VRAM is needed — with the commands to measure.

iaLocale Team
September 21, 2026
Hardware for Local AI: What You Need in 2026
HardwareIntermediate

Hardware for Local AI: What You Need in 2026

The memory rule (weights + KV cache), real October 2026 prices for GPUs, Apple Silicon and CPU, the 36-month cost math and the choice by budget.

iaLocale Team
June 10, 2026