Acceptability Judgment on BLiMP-NL Dutch (test)
73AUCProbe Score
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Probe ScoreModel=Gemma-2-9B, Zero-shot=true2026.05 | 73 | 84 | |
| Probe ScoreModel=Llama-3.1-8B, Zero-shot=true2026.05 | 65 | 77 | |
| LM LogprobModel=Gemma-2-9B, Zero-shot=true2026.05 | 63 | 86 | |
| LM LogprobModel=Llama-3.1-8B, Zero-shot=true2026.05 | 62 | 84 | |
| Probe ScoreModel=Gemma-2-2B, Zero-shot=true2026.05 | 62 | 73 | |
| LM LogprobModel=Gemma-2-2B, Zero-shot=true2026.05 | 61 | 82 | |
| Probe ScoreModel=Llama-3.2-1B, Zero-shot=true2026.05 | 59 | 69 | |
| LM LogprobModel=Llama-3.2-1B, Zero-shot=true2026.05 | 58 | 75 |