N-gram embedding
ArchitecturesA mechanism in which the model indexes short runs of consecutive tokens (bigrams, trigrams) through an embedding table, instead of treating them one by one. It cuts computational cost and memory for very long contexts, and is the scaling axis used by Qwen3.8-Flash-Next (51B of dedicated parameters).
This term in other languages
๐ฎ๐นEmbedding n-gram
๐ซ๐ทEmbedding n-gram

