Skip to main content

Blog

Articles, guides, and insights on local artificial intelligence

12 articles found per "modelli"

Enterprise agents with open-weight models: Gartner's cost report, the math and the 90% rule
ComparisonsIntermediate

Enterprise agents with open-weight models: Gartner's cost report, the math and the 90% rule

The Gartner report (November 2026): 90% of an enterprise agent's steps on open-weight models, at one fifth of a frontier's cost. The three key numbers, the assumptions, and when it's really worth it.

iaLocale Team
November 12, 2026
Decision models in local: JEV-35B and the 3B-active System 1
Use casesIntermediate

Decision models in local: JEV-35B and the 3B-active System 1

You don't need a big LLM to decide. JEV-35B (35B, 3B active) in NVFP4 on a 32GB GPU and ej (11.4MB) on CPU show how to do routing, classification and quality control without generating a single token.

iaLocale Team
October 17, 2026
gpt-oss: OpenAI's open reasoning model
ModelsIntermediate

gpt-oss: OpenAI's open reasoning model

21B total parameters but only 3.6B active, native MXFP4 weights and 128K of context: OpenAI's first open reasoning model fits in 16GB. What that means in practice.

iaLocale Team
October 11, 2026
Qwen3.8-27B vs Gemma 4 26B A4B: the new frontier at 24GB
ComparisonsIntermediate

Qwen3.8-27B vs Gemma 4 26B A4B: the new frontier at 24GB

A 27.8B dense or a MoE with 3.8B active, a 262K context against 256K and almost the same weight at Q4_K_M: two opposite ways of putting big-model quality on a 24GB consumer card. Which is faster, which goes deeper, and when to pick one over the other.

iaLocale Team
October 9, 2026
Local Image Models: from SDXL to Qwen-Image
ModelsIntermediate

Local Image Models: from SDXL to Qwen-Image

From SDXL's 2.6B parameters to Qwen-Image 2.1's 7B: how diffusion models work, how much VRAM you actually need, and which model to pick for your hardware.

iaLocale Team
October 9, 2026
Italian in local models: what to expect
ModelsIntermediate

Italian in local models: what to expect

How many local models actually handle Italian well? The vendor numbers, where they fail, and the half-hour method to measure them yourself.

iaLocale Team
October 4, 2026
GGUF: The Format That Keeps Models on Your Hardware
ModelsIntermediate

GGUF: The Format That Keeps Models on Your Hardware

GGUF is the single-file format that ships models for local inference: a header with a signature and version, key-value metadata, a tensor index, and weights aligned for fast mmap loading. Quantization types with real sizes (8B from 14.96 GiB at F16 to 4.58 GiB at Q4_K_M), the filename convention, and the rule for picking a size against your VRAM or RAM.

iaLocale Team
September 30, 2026
Quantization: Get More From the Same Hardware
ModelsIntermediate

Quantization: Get More From the Same Hardware

Quantization reduces the precision of the weights (from FP16 to 4–8 bit) so models fit in less VRAM and generate more tokens per second. The levels, the real file sizes of Qwen2.5 14B, the rule for choosing from Q4_K_M, and the limits (code, reasoning, languages other than English).

iaLocale Team
September 28, 2026
When a Big Model Isn't Needed: Choosing by Size
ModelsIntermediate

When a Big Model Isn't Needed: Choosing by Size

The method for choosing model size by hardware: the three limits (memory, speed, perceived latency), the VRAM table for Q4 quantization, the hardware classes, and the cases where the small model wins.

iaLocale Team
September 27, 2026
How to Read a Model's Spec Sheet: Family, Size, Context
ModelsIntermediate

How to Read a Model's Spec Sheet: Family, Size, Context

A guide to reading a model's specs: family, total and active size, context window, quantization, benchmarks and license, with a worked example on DeepSeek V4.1 Flash.

iaLocale Team
September 26, 2026
Running LLM Models Locally: From First Install to First Working Model
GuidesIntermediate

Running LLM Models Locally: From First Install to First Working Model

Learn how to install and use large language models on your own computer, without relying on cloud services.

iaLocale Team
June 10, 2026
How to Choose Your First Local AI Model
FundamentalsIntermediate

How to Choose Your First Local AI Model

The three criteria for picking your first local model: use case, memory (with the exact formula) and context, with the recommended models for 8, 16 and 24 GB.

iaLocale Team
June 9, 2026