Reasoning and Math Problem Solving on BoolQ, COPA, WinoGrande, SVAMP, MAWPS (test)
88.2BoolQ AccuracyAUSteer-FFN
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| AUSteer-FFNModel=Qwen3-8B, #Acts=<= 1002026.02 | 88.2 | 90.8 | 67.25 | 71.67 | 89.58 | 81.5 | |
| CAAModel=Qwen3-8B, #Acts=40962026.02 | 87.83 | 91.2 | 64.01 | 71.67 | 88.45 | 80.63 | |
| AUSteer-HeadModel=Qwen3-8B, #Acts=<= 1002026.02 | 87.71 | 95.4 | 65.35 | 76.33 | 91.27 | 83.21 | |
| SADIModel=Qwen3-8B, #Acts=kh * 1282026.02 | 87.65 | 93.2 | 64.25 | 73 | 85.92 | 80.8 | |
| VanillaModel=Qwen3-8B, #Acts=02026.02 | 87.43 | 89 | 63.61 | 68.67 | 84.51 | 78.64 | |
| ITIModel=Qwen3-8B, #Acts=kh * 1282026.02 | 87.4 | 90.8 | 65.59 | 69.67 | 87.32 | 80.16 | |
| AUSteer-FFNModel=Gemma2-9B-it, #Acts=<= 1002026.02 | 87.25 | 97.6 | 70.88 | 70 | 94.08 | 83.96 | |
| STAModel=Gemma2-9B-it, #Acts=35842026.02 | 87.03 | 91.6 | 69.61 | 68.67 | 92.39 | 81.86 | |
| CAAModel=Gemma2-9B-it, #Acts=35842026.02 | 86.85 | 89.4 | 68.35 | 68 | 92.96 | 81.11 | |
| ITIModel=Gemma2-9B-it, #Acts=kh * 2562026.02 | 86.82 | 88.4 | 68.11 | 69 | 93.52 | 81.17 | |
| SADIModel=Gemma2-9B-it, #Acts=kh * 2562026.02 | 86.79 | 92.4 | 69.53 | 68 | 93.52 | 82.05 | |
| AUSteer-HeadModel=Gemma2-9B-it, #Acts=<= 1002026.02 | 86.79 | 91 | 70.72 | 71 | 94.65 | 82.83 | |
| VanillaModel=Gemma2-9B-it, #Acts=02026.02 | 86.64 | 77.4 | 67.25 | 67.67 | 92.11 | 78.21 | |
| AUSteer-HeadModel=LLaMA2-7B-Chat, #Acts=<= 1002026.02 | 76.27 | 75.4 | 52.8 | 37.67 | 56.06 | 59.64 | |
| AUSteer-FFNModel=LLaMA2-7B-Chat, #Acts=<= 1002026.02 | 75.57 | 82.8 | 53.28 | 37 | 58.03 | 61.34 | |
| CAAModel=LLaMA2-7B-Chat, #Acts=40962026.02 | 74.98 | 75.2 | 52.64 | 34.33 | 55.21 | 58.47 | |
| SADIModel=LLaMA2-7B-Chat, #Acts=kh * 1282026.02 | 74.35 | 78.8 | 53.04 | 36.33 | 54.93 | 59.49 | |
| ITIModel=LLaMA2-7B-Chat, #Acts=kh * 1282026.02 | 74.1 | 77.2 | 52.8 | 36.67 | 54.08 | 58.97 | |
| VanillaModel=LLaMA2-7B-Chat, #Acts=02026.02 | 70.52 | 70.8 | 50.91 | 36 | 51.83 | 56.01 |