Acceptability Judgment on ScaLA sv Swedish (test)
83AUCProbe Score
Evaluation results
| Method | Links | |
|---|---|---|
| Probe ScoreModel=Gemma-2-9B, Zero-shot=true2026.05 | 83 | |
| Probe ScoreModel=Llama-3.1-8B, Zero-shot=true2026.05 | 74 | |
| Probe ScoreModel=Gemma-2-2B, Zero-shot=true2026.05 | 69 | |
| Probe ScoreModel=Llama-3.2-1B, Zero-shot=true2026.05 | 68 | |
| LM LogprobModel=Gemma-2-9B, Zero-shot=true2026.05 | 66 | |
| LM LogprobModel=Llama-3.1-8B, Zero-shot=true2026.05 | 65 | |
| LM LogprobModel=Gemma-2-2B, Zero-shot=true2026.05 | 64 | |
| LM LogprobModel=Llama-3.2-1B, Zero-shot=true2026.05 | 62 |