Speculative Decoding

An inference technique: a small draft model proposes tokens and the large model verifies them in a single pass, accepting or correcting them. The result is more tokens per second with no quality change. Modern variants: MTP (Multi-Token Prediction, built into Qwen3.8 checkpoints) and EAGLE (e.g. on Mistral Medium 3.5).