GDDR7

The current generation of graphics memory: up to 32 Gbps per pin — 1 TB/s on a 256-bit bus (RTX 5090). For local inference, memory bandwidth sets generation speed: NVIDIA's Blackwell cards use it across the 50 series, and the 2026 GDDR7 price surge has pushed street prices up across the mid-range.