List your company
ResearchFormerly WizWand

Acceptability Judgment on JCoLA (Japanese) (test)

0.7AUCProbe Score
0.56480.59990.6350.6701May 6, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Probe ScoreModel=Gemma-2-9B, Zero-shot=true2026.050.7
Probe ScoreModel=Llama-3.1-8B, Zero-shot=true2026.050.63
Probe ScoreModel=Gemma-2-2B, Zero-shot=true2026.050.61
LM LogprobModel=Llama-3.1-8B, Zero-shot=true2026.050.59
LM LogprobModel=Gemma-2-2B, Zero-shot=true2026.050.59
LM LogprobModel=Gemma-2-9B, Zero-shot=true2026.050.59
LM LogprobModel=Llama-3.2-1B, Zero-shot=true2026.050.57
Probe ScoreModel=Llama-3.2-1B, Zero-shot=true2026.050.57