Opinion Alignment on smartvote 2023 Swiss national elections (test)
70.73Mean Macro-F1SFT+GRPO
Evaluation results
| Method | Links | |
|---|---|---|
| SFT+GRPOBase model=Magistral 24B2026.03 | 70.73 | |
| SFTBase model=Magistral 24B2026.03 | 67.63 | |
| SFT+GRPOBase model=Llama 3.1 8B2026.03 | 66.88 | |
| iclBase model=Magistral 24B2026.03 | 66.16 | |
| SFT+GRPOBase model=Qwen3 8B2026.03 | 65.11 | |
| SFTBase model=Llama 3.1 8B2026.03 | 63.44 | |
| SFTBase model=Qwen3 8B2026.03 | 61.08 | |
| GRPOBase model=Qwen3 8B2026.03 | 60.64 | |
| GRPOBase model=Magistral 24B2026.03 | 60.56 | |
| iclBase model=Qwen3 8B2026.03 | 60.48 | |
| iclBase model=Llama 3.1 8B2026.03 | 55.97 | |
| GRPOBase model=Llama 3.1 8B2026.03 | 55.14 | |
| randomBase model=Untrained baselines2026.03 | 50 | |
| ORPOBase model=Llama 3.1 8B2026.03 | 43.53 | |
| majorityBase model=Untrained baselines2026.03 | 37.43 | |
| ORPOBase model=Qwen3 8B2026.03 | 23.87 | |
| ORPOBase model=Magistral 24B2026.03 | 23.31 |