Skip to main content
← Back to glossary

Context compression

Techniques

Technique to shrink the part of the context sent to the model at a reasoning step, dropping or summarizing retrieved or historical portions the current step does not use. Examples: summaries generated by another model (ACON, Context-Folding), token removal via a learned policy (LLMLingua-2), or chunk selection based on the model's own attention (QRAE). On multi-step agents it cuts tokens and latency without, when done well, degrading quality.

Related articles

This term in other languages