Text Compression on SciTLDR (test)
44.9ROUGE-1 F1CATT
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CATT2026.04 | 44.9 | 22.6 | 37.3 | — | — | 47.3 | |
| Full FTTraining Duration=5ep, Context Length=16k2026.04 | 1.31 | 0.014 | 1.3 | 54.74 | 23.26 | 22.43 | |
| Llama 3.2 3B InstructParameters=3B, Series=Llama 3.2, Type=Instruct2026.04 | 1.21 | 0.011 | 1.21 | 54.55 | 24.45 | 20.72 | |
| Llama 3.1 8B InstructParameters=8B, Series=Llama 3.1, Type=Instruct2026.04 | 1.21 | 0.014 | 1.21 | 54.57 | 24.81 | 20.79 |