Multilingual Topic and Sentiment Classification on SIB-200 and Sentiment Collection (test)
4.05AM ScoreQuality Steering
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Quality SteeringLLM=Llama3.1 8b, Layer=L23, Alpha=4.02026.06 | 4.05 | -0.43 | -1.72 | 1.49 | -1.53 | 0.71 | -1.08 | 2.97 | -2.02 | -0.71 | 0.2 | 0.17 | |
| Language SteeringLLM=Llama3.1 70b, Layer=L17, Alpha=1.02026.06 | 1.85 | -0.23 | -0.13 | 0.91 | 1.32 | -0.08 | 0.32 | 0.3 | -1.2 | 0.43 | 2.04 | 0.5 | |
| Language SteeringLLM=Gemma 2 27b, Layer=L10, Alpha=25.02026.06 | 1.58 | 2.48 | 0.63 | 1.73 | 3.25 | 1.36 | -0.96 | 2.27 | -0.39 | 3.55 | -1.76 | 1.25 | |
| Quality SteeringLLM=Llama3.1 70b, Layer=L17, Alpha=1.02026.06 | 1.55 | 0.68 | 0.31 | 1.45 | 2.83 | 0.74 | 1.37 | -0.46 | 1.79 | 1.12 | 2.51 | 1.26 | |
| Quality SteeringLLM=Llama3.1 8b, Layer=L15, Alpha=3.02026.06 | 1.49 | 0.32 | -0.08 | 1.56 | -1.37 | -0.03 | -2.39 | 3.06 | -6.14 | -0.39 | -0.9 | -0.44 | |
| Language SteeringLLM=Llama3.1 8b, Layer=L15, Alpha=2.02026.06 | 1.39 | 0.12 | -1.09 | 1.32 | -1.07 | -0.63 | 0.7 | 2.36 | -0.38 | 1.83 | -0.9 | 0.33 | |
| Quality SteeringLLM=Llama3.1 8b, Layer=L7, Alpha=2.02026.06 | 1.03 | 1.82 | 1.7 | 1.03 | 0.72 | 1 | -1.36 | 3.13 | 0.04 | -0.67 | 0.05 | 0.77 | |
| Language SteeringLLM=Gemma 2 27b, Layer=L34, Alpha=25.02026.06 | 0.97 | 2.58 | 0.34 | 0.35 | -0.26 | 2.29 | -0.69 | 1.66 | -0.75 | 2.32 | -0.87 | 0.72 | |
| Quality SteeringLLM=Gemma 2 27b, Layer=L34, Alpha=25.02026.06 | 0.97 | 2.58 | 0.34 | 0.35 | -0.26 | 2.29 | -0.69 | 1.66 | -0.75 | 2.32 | -0.87 | 0.72 | |
| Quality SteeringLLM=Gemma 2 9b, Layer=L9, Alpha=25.02026.06 | 0.74 | 0.87 | 2.75 | -0.2 | 1.75 | 0.37 | 1.57 | 3.19 | 0.61 | 0.78 | -0.09 | 1.12 | |
| Language SteeringLLM=Llama3.1 70b, Layer=L57, Alpha=1.02026.06 | 0.63 | 0.68 | 0.82 | 0.93 | 2.96 | 1.41 | -0.24 | 0.21 | 0.06 | 1.42 | 3.91 | 1.16 | |
| Quality SteeringLLM=Gemma 2 27b, Layer=L22, Alpha=75.02026.06 | 0.04 | 3.68 | -0.63 | 2.06 | -0.45 | 2.66 | -0.95 | 0.81 | 0.99 | 3.32 | -1.72 | 0.89 | |
| Language SteeringLLM=Llama3.1 8b, Layer=L23, Alpha=3.02026.06 | -0.14 | -0.07 | 1.77 | 1.73 | 0.35 | 2.61 | 0.7 | 0.13 | -0.17 | 1.1 | -1.28 | 0.61 | |
| Language SteeringLLM=Gemma 2 9b, Layer=L20, Alpha=50.02026.06 | -0.17 | 0.96 | 1.19 | 0.87 | -0.02 | -0.21 | 0.97 | -2.13 | 3.36 | -0.47 | -1.45 | 0.26 | |
| Quality SteeringLLM=Gemma 2 27b, Layer=L10, Alpha=75.02026.06 | -0.45 | 2.18 | 2.52 | 1.25 | 0.72 | 2.26 | -0.28 | 2.11 | 2.31 | 4.73 | -1.3 | 1.46 | |
| Language SteeringLLM=Gemma 2 27b, Layer=L22, Alpha=50.02026.06 | -0.64 | 2.48 | 0 | -0.59 | 1.85 | 1.04 | -1.19 | 0 | -0.2 | 5.51 | -1.35 | 0.63 | |
| Language SteeringLLM=Llama3.1 70b, Layer=L37, Alpha=2.02026.06 | -0.7 | 1.28 | 0.89 | 0.37 | 3.46 | 1.26 | 0.08 | 2.21 | 1.61 | 0.51 | 2.85 | 1.26 | |
| Quality SteeringLLM=Llama3.1 70b, Layer=L37, Alpha=1.02026.06 | -0.7 | 0.7 | 0.8 | -0.03 | 2.84 | -0.58 | -0.28 | -0.44 | 0.42 | -0.09 | 4.77 | 0.67 | |
| Language SteeringLLM=Llama3.1 8b, Layer=L7, Alpha=2.02026.06 | -1.23 | -0.24 | 2.5 | 1.23 | 0.33 | 1.49 | -1.66 | 2.95 | -1.21 | 1.8 | -2.25 | 0.34 | |
| Quality SteeringLLM=Llama3.1 70b, Layer=L57, Alpha=2.02026.06 | -1.4 | 1.02 | 0.46 | -0.9 | 1.25 | -0.52 | 0.45 | 2.44 | 1.89 | 0.43 | 5.48 | 0.96 | |
| Quality SteeringLLM=Gemma 2 9b, Layer=L31, Alpha=50.02026.06 | -1.51 | -0.45 | 2.68 | 1.31 | 0.27 | 0.62 | -2.7 | -1.2 | 3.75 | -0.67 | -0.11 | 0.18 | |
| Language SteeringLLM=Gemma 2 9b, Layer=L31, Alpha=50.02026.06 | -2.35 | 0.25 | 3.99 | -0.77 | 0.02 | 0.03 | 0.2 | -1 | 2.44 | -1.08 | 0.49 | 0.2 | |
| Quality SteeringLLM=Gemma 2 9b, Layer=L20, Alpha=25.02026.06 | -3.42 | -0.72 | 1.07 | -0.05 | 0.01 | 1.31 | 1.13 | 0.48 | -0.24 | -0.02 | -1.92 | -0.22 | |
| Language SteeringLLM=Gemma 2 9b, Layer=L9, Alpha=25.02026.06 | -4.14 | 0.34 | 0.24 | 1.48 | -0.54 | -1.54 | 0.51 | -1.97 | 2.06 | -1.16 | -0.49 | -0.47 |