Language Modeling on AdaptEval (test)
1.6598NLLLayer-wise Dynamic TTA (SCALENET)
Evaluation results
| Method | Links | |
|---|---|---|
| Layer-wise Dynamic TTA (SCALENET)LLM=Llama3.3-70B-Instruct, TTA Steps=12026.02 | 1.6598 | |
| Layer-wise Dynamic TTA (SCALENET)LLM=Llama3.3-70B-Instruct, TTA Steps=22026.02 | 1.6692 | |
| Layer-wise Dynamic TTA (SCALENET)LLM=Llama3.3-70B-Instruct, TTA Steps=42026.02 | 1.6741 | |
| Layer-wise Dynamic TTA (SCALENET)LLM=Llama3.3-70B-Instruct, TTA Steps=32026.02 | 1.679 | |
| Layer-wise Dynamic TTA (SCALENET)LLM=Llama3.3-70B-Instruct, TTA Steps=52026.02 | 1.7048 | |
| Layer-wise Dynamic TTA (SCALENET)LLM=Qwen3-32B, TTA Steps=42026.02 | 1.8739 | |
| Layer-wise Dynamic TTA (SCALENET)LLM=Qwen3-32B, TTA Steps=32026.02 | 1.8777 | |
| Layer-wise Dynamic TTA (SCALENET)LLM=Qwen3-32B, TTA Steps=52026.02 | 1.8889 | |
| Layer-wise Dynamic TTA (SCALENET)LLM=Qwen3-32B, TTA Steps=22026.02 | 1.9168 | |
| Step-wise Dynamic TTALLM=Qwen3-32B, TTA Steps=42026.02 | 2.0829 | |
| Step-wise Dynamic TTALLM=Qwen3-32B, TTA Steps=32026.02 | 2.0842 | |
| Step-wise Dynamic TTALLM=Qwen3-32B, TTA Steps=22026.02 | 2.0892 | |
| Step-wise Dynamic TTALLM=Qwen3-32B, TTA Steps=52026.02 | 2.0925 | |
| Layer-wise Dynamic TTA (SCALENET)LLM=Qwen3-32B, TTA Steps=12026.02 | 2.1107 | |
| Step-wise Dynamic TTALLM=Qwen3-32B, TTA Steps=12026.02 | 2.1303 | |
| Step-wise Dynamic TTALLM=Llama3.3-70B-Instruct, TTA Steps=22026.02 | 2.1399 | |
| Step-wise Dynamic TTALLM=Llama3.3-70B-Instruct, TTA Steps=12026.02 | 2.1665 | |
| Fixed-rate TTALLM=Qwen3-32B, TTA Steps=52026.02 | 2.1682 | |
| Fixed-rate TTALLM=Qwen3-32B, TTA Steps=42026.02 | 2.1725 | |
| Fixed-rate TTALLM=Qwen3-32B, TTA Steps=32026.02 | 2.1757 | |
| Fixed-rate TTALLM=Qwen3-32B, TTA Steps=22026.02 | 2.1784 | |
| No TTALLM=Qwen3-32B, TTA Steps=02026.02 | 2.1805 | |
| Fixed-rate TTALLM=Qwen3-32B, TTA Steps=12026.02 | 2.1809 | |
| Step-wise Dynamic TTALLM=Llama3.3-70B-Instruct, TTA Steps=32026.02 | 2.185 | |
| Fixed-rate TTALLM=Llama3.3-70B-Instruct, TTA Steps=12026.02 | 2.1907 | |
| Step-wise Dynamic TTALLM=Llama3.3-70B-Instruct, TTA Steps=42026.02 | 2.1997 | |
| No TTALLM=Llama3.3-70B-Instruct, TTA Steps=02026.02 | 2.2114 | |
| Step-wise Dynamic TTALLM=Llama3.3-70B-Instruct, TTA Steps=52026.02 | 2.2657 | |
| Fixed-rate TTALLM=Llama3.3-70B-Instruct, TTA Steps=22026.02 | 5.8488 | |
| Fixed-rate TTALLM=Llama3.3-70B-Instruct, TTA Steps=32026.02 | 9.6803 | |
| Fixed-rate TTALLM=Llama3.3-70B-Instruct, TTA Steps=52026.02 | 11.497 | |
| Fixed-rate TTALLM=Llama3.3-70B-Instruct, TTA Steps=42026.02 | 11.5891 |