Multi-task Language Understanding on MMLU-Pro (Wall-clock time)
0.84Wall-clock Time (s)DSC
Evaluation Results
| Method | Links | |
|---|---|---|
| DSCBudget (B)=16, LLM batch size=12025.11 | 0.84 | |
| CGES-LNS (arith)Budget (B)=16, LLM batch size=12025.11 | 1.27 | |
| CGES-DeepConf (B10)Budget (B)=16, LLM batch size=1, DeepConf setting=B102025.11 | 1.27 | |
| CGES-DeepConf (tail)Budget (B)=16, LLM batch size=1, DeepConf setting=tail2025.11 | 1.27 | |
| ASC-βBudget (B)=16, LLM batch size=12025.11 | 1.31 | |
| ESCBudget (B)=16, LLM batch size=1, window size w=42025.11 | 1.38 | |
| CGES-LNS (geom)Budget (B)=16, LLM batch size=12025.11 | 1.38 | |
| ASC-DirBudget (B)=16, LLM batch size=12025.11 | 1.39 | |
| CGES-MARSBudget (B)=16, LLM batch size=12025.11 | 1.67 | |
| ESCBudget (B)=16, LLM batch size=1, window size w=82025.11 | 1.97 | |
| SCBudget (B)=16, LLM batch size=12025.11 | 2.45 | |
| CGES-RMBudget (B)=16, LLM batch size=12025.11 | 2.8 |