Few-shot Learning on LongBench
82.62TREC ScoreGlyph
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GlyphApproach=Implicit compression2025.12 | 82.62 | 88.54 | — | — | |
| LingoEDUBackbone=GPT-4.1, Approach=EDU-based context compression2025.12 | 80 | 93.76 | 41.68 | 52.5 | |
| Self-SumBackbone=GPT-4.1, Approach=LLM-generated abstractive summary2025.12 | 79 | 93.69 | 40.79 | 50.5 | |
| StandardBackbone=GPT-4.1, Approach=Full context2025.12 | 77 | 90.07 | 39.2 | 48.6 | |
| FullKVBackbone=Qwen3-8B, KV Cache Size=Full2026.03 | 71.67 | 91.79 | 42.07 | — | |
| CompilerKVModel=InternLM-2.5-Chat-1M, KV cache size=1282026.02 | 70.5 | 83.43 | 32.76 | — | |
| FullKVBackbone=Llama3-8B-Instruct, KV Cache Size=Full2026.03 | 70 | 89.85 | 40.55 | — | |
| CompilerKVModel=Mistral-7B-Instruct-v0.2, KV cache size=1282026.02 | 68.2 | 85 | 41.2 | — | |
| FullKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=Full2026.03 | 66.33 | 89.34 | 42.49 | — | |
| CompilerKVModel=LLaMA-3-8B-Instruct, KV cache size=1282026.02 | 66 | 89.68 | 39 | — | |
| SnapKVBackbone=Qwen3-8B, KV Cache Size=2562026.03 | 63 | 91.07 | 38.57 | — | |
| DapQBackbone=Qwen3-8B, KV Cache Size=2562026.03 | 62.67 | 91.15 | 39.61 | — | |
| PyramidKVBackbone=Qwen3-8B, KV Cache Size=2562026.03 | 61.67 | 90.96 | 37.65 | — | |
| DapQBackbone=Llama3-8B-Instruct, KV Cache Size=2562026.03 | 60.67 | 90.48 | 38.34 | — | |
| CompilerKVModel=Qwen2-7B-Instruct, KV cache size=1282026.02 | 60 | 88.38 | 41.05 | — | |
| PyramidKVBackbone=Llama3-8B-Instruct, KV Cache Size=2562026.03 | 60 | 89.26 | 37.07 | — | |
| LingoEDUBackbone=Gemini-2.5-Pro, Approach=EDU-based context compression2025.12 | 57.5 | 63.25 | 23.8 | 35.48 | |
| SnapKVBackbone=Llama3-8B-Instruct, KV Cache Size=2562026.03 | 57 | 89.65 | 36.97 | — | |
| DapQBackbone=Qwen2.5-7B-Instruct, KV Cache Size=2562026.03 | 56.67 | 88.64 | 39.92 | — | |
| DapQBackbone=Qwen3-8B, KV Cache Size=1282026.03 | 54 | 90.45 | 38.5 | — | |
| SnapKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=2562026.03 | 53.33 | 87.66 | 39.34 | — | |
| PyramidKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=2562026.03 | 53 | 87.89 | 39.61 | — | |
| SnapKVBackbone=Qwen3-8B, KV Cache Size=1282026.03 | 51.33 | 91.07 | 37.37 | — | |
| DapQBackbone=Llama3-8B-Instruct, KV Cache Size=1282026.03 | 50 | 90.06 | 36.87 | — | |
| Self-SumBackbone=Gemini-2.5-Pro, Approach=LLM-generated abstractive summary2025.12 | 49 | 62.31 | 21.89 | 29.5 | |
| PyramidKVBackbone=Llama3-8B-Instruct, KV Cache Size=1282026.03 | 49 | 87.68 | 36.73 | — | |
| PyramidKVBackbone=Qwen3-8B, KV Cache Size=1282026.03 | 48.33 | 89.31 | 36.92 | — | |
| SnapKVBackbone=Llama3-8B-Instruct, KV Cache Size=1282026.03 | 47.67 | 87.82 | 35.63 | — | |
| DapQBackbone=Qwen2.5-7B-Instruct, KV Cache Size=1282026.03 | 47 | 84.92 | 38.07 | — | |
| StandardBackbone=Gemini-2.5-Pro, Approach=Full context2025.12 | 46.5 | 59.85 | 20.45 | 26.1 | |
| H2OBackbone=Qwen3-8B, KV Cache Size=2562026.03 | 46.33 | 90.04 | 38.98 | — | |
| H2OBackbone=Llama3-8B-Instruct, KV Cache Size=2562026.03 | 45.67 | 89.49 | 38.28 | — | |
| PyramidKVBackbone=Qwen3-8B, KV Cache Size=642026.03 | 44.67 | 88.27 | 34.63 | — | |
| H2OBackbone=Qwen2.5-7B-Instruct, KV Cache Size=2562026.03 | 44.33 | 84.51 | 39.77 | — | |
| PyramidKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=1282026.03 | 43.33 | 84.69 | 38.4 | — | |
| DapQBackbone=Qwen3-8B, KV Cache Size=642026.03 | 43 | 88.97 | 36 | — | |
| SnapKVBackbone=Qwen3-8B, KV Cache Size=642026.03 | 42.67 | 87.93 | 35.12 | — | |
| SnapKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=1282026.03 | 42.33 | 83.91 | 38.89 | — | |
| H2OBackbone=Qwen3-8B, KV Cache Size=1282026.03 | 41.33 | 90.21 | 38.16 | — | |
| SnapKVBackbone=Llama3-8B-Instruct, KV Cache Size=642026.03 | 40.67 | 86.02 | 33.99 | — | |
| H2OBackbone=Qwen2.5-7B-Instruct, KV Cache Size=1282026.03 | 40.67 | 81.43 | 38.56 | — | |
| H2OBackbone=Llama3-8B-Instruct, KV Cache Size=1282026.03 | 40 | 87.29 | 36.25 | — | |
| DapQBackbone=Qwen2.5-7B-Instruct, KV Cache Size=642026.03 | 39.67 | 84.16 | 35.49 | — | |
| PyramidKVBackbone=Llama3-8B-Instruct, KV Cache Size=642026.03 | 39 | 76.8 | 32.31 | — | |
| H2OBackbone=Qwen3-8B, KV Cache Size=642026.03 | 39 | 88.13 | 35.98 | — | |
| DapQBackbone=Llama3-8B-Instruct, KV Cache Size=642026.03 | 38.67 | 87.38 | 35.3 | — | |
| SnapKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=642026.03 | 37.67 | 85.11 | 36.92 | — | |
| H2OBackbone=Llama3-8B-Instruct, KV Cache Size=642026.03 | 37.33 | 86.27 | 35.18 | — | |
| H2OBackbone=Qwen2.5-7B-Instruct, KV Cache Size=642026.03 | 37.33 | 82.76 | 35.27 | — | |
| PyramidKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=642026.03 | 37.33 | 84.81 | 35.58 | — | |
| C3Approach=Latent-based compression2025.12 | 1 | 6.42 | 8.29 | 6.5 |