Acceptability Judgment on ItaCoLA Italian (test)
0.7AUCProbe Score
Evaluation Results
| Method | Links | |
|---|---|---|
| Probe ScoreModel=Gemma-2-9B, Zero-shot=true2026.05 | 0.7 | |
| Probe ScoreModel=Llama-3.1-8B, Zero-shot=true2026.05 | 0.65 | |
| Probe ScoreModel=Gemma-2-2B, Zero-shot=true2026.05 | 0.62 | |
| LM LogprobModel=Llama-3.1-8B, Zero-shot=true2026.05 | 0.61 | |
| Probe ScoreModel=Llama-3.2-1B, Zero-shot=true2026.05 | 0.59 | |
| LM LogprobModel=Llama-3.2-1B, Zero-shot=true2026.05 | 0.58 | |
| LM LogprobModel=Gemma-2-9B, Zero-shot=true2026.05 | 0.56 | |
| LM LogprobModel=Gemma-2-2B, Zero-shot=true2026.05 | 0.55 |