Skip to main content

Blog

Articles, guides, and insights on local artificial intelligence

8 articles found per "quantizzazione"

Ripple-65B: a 64.8B dense in Apache-2.0, the math of running it locally
ModelsIntermediate

Ripple-65B: a 64.8B dense in Apache-2.0, the math of running it locally

64.8B parameters, Apache 2.0, 1M of context and an NVFP4 checkpoint designed for 128 GB of unified memory: the math and the criteria for running a frontier dense locally.

iaLocale Team
November 19, 2026
Mistral Large 4 in open weights: a 1T MoE (52B active) for on-premise inference
ModelsIntermediate

Mistral Large 4 in open weights: a 1T MoE (52B active) for on-premise inference

Mistral released Large 4 in open weights (1.03T total, 52B active, 1M context, open-weight license): an article teaching how to read MoE specs and do the RAM, quantization and speed math for on-premise inference.

iaLocale Team
November 14, 2026
MOSS-Image: OpenMOSS-Team's ComfyUI ripack, workflows and real requirements
Use casesIntermediate

MOSS-Image: OpenMOSS-Team's ComfyUI ripack, workflows and real requirements

MOSS-Image: OpenMOSS-Team's ComfyUI ripack, ready in two folders. Real-world VRAM computed per weights combination, from ~11GB to ~31GB, plus the four included workflows.

iaLocale Team
October 31, 2026
GGUF: The Format That Keeps Models on Your Hardware
ModelsIntermediate

GGUF: The Format That Keeps Models on Your Hardware

GGUF is the single-file format that ships models for local inference: a header with a signature and version, key-value metadata, a tensor index, and weights aligned for fast mmap loading. Quantization types with real sizes (8B from 14.96 GiB at F16 to 4.58 GiB at Q4_K_M), the filename convention, and the rule for picking a size against your VRAM or RAM.

iaLocale Team
September 30, 2026
Quantization: Get More From the Same Hardware
ModelsIntermediate

Quantization: Get More From the Same Hardware

Quantization reduces the precision of the weights (from FP16 to 4–8 bit) so models fit in less VRAM and generate more tokens per second. The levels, the real file sizes of Qwen2.5 14B, the rule for choosing from Q4_K_M, and the limits (code, reasoning, languages other than English).

iaLocale Team
September 28, 2026
When a Big Model Isn't Needed: Choosing by Size
ModelsIntermediate

When a Big Model Isn't Needed: Choosing by Size

The method for choosing model size by hardware: the three limits (memory, speed, perceived latency), the VRAM table for Q4 quantization, the hardware classes, and the cases where the small model wins.

iaLocale Team
September 27, 2026
How to Read a Model's Spec Sheet: Family, Size, Context
ModelsIntermediate

How to Read a Model's Spec Sheet: Family, Size, Context

A guide to reading a model's specs: family, total and active size, context window, quantization, benchmarks and license, with a worked example on DeepSeek V4.1 Flash.

iaLocale Team
September 26, 2026
vLLM: serving models fast
GuidesAdvanced

vLLM: serving models fast

vLLM is the open-source engine that turns a local model into a concurrent server: PagedAttention, continuous batching, installation and the key concepts for choosing when to use it instead of Ollama.

iaLocale Team
September 20, 2026