Abstractive Summarization on LongLaMP Abs
43.91ROUGE-1SpecSteer
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SpecSteerPair=C, Backbone=Qwen3 8B/32B2026.03 | 43.91 | 23.54 | |
| SLM+Pair=C, Backbone=Qwen3 8B/32B, Note=retrieval-augmented specialist2026.03 | 41.38 | 22.33 | |
| SpecSteerPair=A, Backbone=Qwen3 0.6B/32B2026.03 | 41.35 | 23.57 | |
| LLMPair=A, Backbone=Qwen3 0.6B/32B2026.03 | 40.18 | 22.17 | |
| LLMPair=C, Backbone=Qwen3 8B/32B2026.03 | 40.18 | 22.17 | |
| SLM+Pair=A, Backbone=Qwen3 0.6B/32B, Note=retrieval-augmented specialist2026.03 | 39.89 | 21.65 | |
| SLMPair=C, Backbone=Qwen3 8B/32B2026.03 | 39.85 | 21.31 | |
| SpecSteerPair=B, Backbone=Qwen2.5 1.5B/32B2026.03 | 39.73 | 21.06 | |
| SpecSteerPair=D, Backbone=Llama2026.03 | 39.54 | 21.38 | |
| LLMPair=D, Backbone=Llama2026.03 | 39.04 | 21.23 | |
| LLMPair=B, Backbone=Qwen2.5 1.5B/32B2026.03 | 38.5 | 20.51 | |
| SLM+Pair=D, Backbone=Llama, Note=retrieval-augmented specialist2026.03 | 37.89 | 20.36 | |
| SLMPair=B, Backbone=Qwen2.5 1.5B/32B2026.03 | 36.97 | 17.6 | |
| SLM+Pair=B, Backbone=Qwen2.5 1.5B/32B, Note=retrieval-augmented specialist2026.03 | 36.81 | 19 | |
| SLMPair=A, Backbone=Qwen3 0.6B/32B2026.03 | 36.58 | 20.34 | |
| SLMPair=D, Backbone=Llama2026.03 | 36.24 | 19.35 |