Summarization on XL-Sum (test)
13.9ROUGE-LGemma 270M
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemma 270MDecoding strategy=greedy decoding, max_input_tokens=512, max_new_tokens=80, KV-cache usage=true2026.05 | 13.9 | 25.73 | 78.4 | |
| ACROSDecoding strategy=greedy decoding, max_input_tokens=512, max_new_tokens=80, KV-cache usage=false2026.05 | 11 | 18.3 | 12.5 | |
| Qwen2 0.5BDecoding strategy=greedy decoding, max_input_tokens=512, max_new_tokens=80, KV-cache usage=true2026.05 | 10.9 | 20.23 | 41.1 | |
| Base SmolLM2Decoding strategy=greedy decoding, max_input_tokens=512, max_new_tokens=80, KV-cache usage=true2026.05 | 8.8 | 15.3 | 36.8 | |
| Frozen BPDecoding strategy=greedy decoding, max_input_tokens=512, max_new_tokens=80, KV-cache usage=false2026.05 | 1.3 | 2.81 | 0 |