Blog
Articles, guides, and insights on local artificial intelligence
4 articles found per "gpu"

NVIDIA's Cosmos3-H-Dreams: real-time surgical simulation, and local robotics
A 15B world model that generates robotic surgery video in real time on a single GPU: what it changes for local robotics.

MagpieTTS 357M: 12-language speech synthesis that runs on a laptop
NVIDIA releases MagpieTTS Multilingual, 364M parameters and 12 languages in one model: local text-to-speech with a 332 MB GGUF file, no GPU. The C++ runtime NeMo-Speech.cpp takes you from zero to first audio in three commands; the five voices are the same in every language, and for a natively Italian voice Piper is still ahead.

Decision models in local: JEV-35B and the 3B-active System 1
You don't need a big LLM to decide. JEV-35B (35B, 3B active) in NVFP4 on a 32GB GPU and ej (11.4MB) on CPU show how to do routing, classification and quality control without generating a single token.

Costs: local vs API, done with real numbers
How much does local really cost compared to a cloud API? Verified per-token prices, GPU amortization, electricity and the break-even point, calculated with real numbers.

