List your company
ResearchFormerly WizWand

Acceptability Judgment on ItaCoLA Italian (test)

0.7AUCProbe Score
0.5440.58450.6250.6655May 6, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Probe ScoreModel=Gemma-2-9B, Zero-shot=true2026.050.7
Probe ScoreModel=Llama-3.1-8B, Zero-shot=true2026.050.65
Probe ScoreModel=Gemma-2-2B, Zero-shot=true2026.050.62
LM LogprobModel=Llama-3.1-8B, Zero-shot=true2026.050.61
Probe ScoreModel=Llama-3.2-1B, Zero-shot=true2026.050.59
LM LogprobModel=Llama-3.2-1B, Zero-shot=true2026.050.58
LM LogprobModel=Gemma-2-9B, Zero-shot=true2026.050.56
LM LogprobModel=Gemma-2-2B, Zero-shot=true2026.050.55