Summarization on XSum (ROUGE-Lsum)
22.47ROUGE-LsumSCALENET (Layer-wise)
Evaluation results
| Method | Links | |
|---|---|---|
| SCALENET (Layer-wise)LLM Backbone=Qwen4B-Instruct, TTA Steps=5, TTA Method=Layer-wise2026.02 | 22.47 | |
| SCALENET (Layer-wise)LLM Backbone=Qwen4B-Instruct, TTA Steps=1, TTA Method=Layer-wise2026.02 | 21.57 | |
| SCALENET (Layer-wise)LLM Backbone=Llama3B-Instruct, TTA Steps=5, TTA Method=Layer-wise2026.02 | 20.9 | |
| SCALENET (Layer-wise)LLM Backbone=Llama3B-Instruct, TTA Steps=1, TTA Method=Layer-wise2026.02 | 19.64 | |
| SCALENET (Step-wise)LLM Backbone=Llama3B-Instruct, TTA Steps=5, TTA Method=Step-wise2026.02 | 19.04 | |
| SCALENET (Step-wise)LLM Backbone=Qwen4B-Instruct, TTA Steps=1, TTA Method=Step-wise2026.02 | 18.72 | |
| SCALENET (Step-wise)LLM Backbone=Qwen4B-Instruct, TTA Steps=5, TTA Method=Step-wise2026.02 | 18.64 | |
| SCALENET (Step-wise)LLM Backbone=Llama3B-Instruct, TTA Steps=1, TTA Method=Step-wise2026.02 | 18.38 | |
| Base ModelLLM Backbone=Llama3B-Instruct, TTA Steps=0, TTA Method=None2026.02 | 18.21 | |
| Naive TTALLM Backbone=Llama3B-Instruct, TTA Steps=1, TTA Method=Fixed2026.02 | 18 | |
| Naive TTALLM Backbone=Llama3B-Instruct, TTA Steps=5, TTA Method=Fixed2026.02 | 17.8 | |
| Naive TTALLM Backbone=Qwen4B-Instruct, TTA Steps=5, TTA Method=Fixed2026.02 | 17.73 | |
| Base ModelLLM Backbone=Qwen4B-Instruct, TTA Steps=0, TTA Method=None2026.02 | 17 | |
| Naive TTALLM Backbone=Qwen4B-Instruct, TTA Steps=1, TTA Method=Fixed2026.02 | 17 |