Language Model Evaluation on AdaptEval
0.2733ROUGE-LsumSCALENET (Layer-wise)
Evaluation results
| Method | Links | |
|---|---|---|
| SCALENET (Layer-wise)LLM Backbone=Llama70B-Instruct, TTA Steps=5, TTA Method=Layer-wise2026.02 | 0.2733 | |
| Base ModelLLM Backbone=Llama70B-Instruct, TTA Steps=0, TTA Method=None2026.02 | 0.2327 | |
| Naive TTALLM Backbone=Llama70B-Instruct, TTA Steps=1, TTA Method=Fixed2026.02 | 0.2325 | |
| SCALENET (Layer-wise)LLM Backbone=Llama70B-Instruct, TTA Steps=1, TTA Method=Layer-wise2026.02 | 0.2237 | |
| SCALENET (Step-wise)LLM Backbone=Llama70B-Instruct, TTA Steps=5, TTA Method=Step-wise2026.02 | 0.2223 | |
| SCALENET (Step-wise)LLM Backbone=Llama70B-Instruct, TTA Steps=1, TTA Method=Step-wise2026.02 | 0.2068 | |
| SCALENET (Layer-wise)LLM Backbone=Qwen32B, TTA Steps=5, TTA Method=Layer-wise2026.02 | 0.1043 | |
| Naive TTALLM Backbone=Qwen32B, TTA Steps=5, TTA Method=Fixed2026.02 | 0.1004 | |
| Naive TTALLM Backbone=Qwen32B, TTA Steps=1, TTA Method=Fixed2026.02 | 0.0992 | |
| SCALENET (Step-wise)LLM Backbone=Qwen32B, TTA Steps=5, TTA Method=Step-wise2026.02 | 0.099 | |
| Base ModelLLM Backbone=Qwen32B, TTA Steps=0, TTA Method=None2026.02 | 0.0987 | |
| SCALENET (Layer-wise)LLM Backbone=Qwen32B, TTA Steps=1, TTA Method=Layer-wise2026.02 | 0.0983 | |
| SCALENET (Step-wise)LLM Backbone=Qwen32B, TTA Steps=1, TTA Method=Step-wise2026.02 | 0.0982 | |
| Naive TTALLM Backbone=Llama70B-Instruct, TTA Steps=5, TTA Method=Fixed2026.02 | 0.0029 |