Pronoun Prediction Calibration on GenderLex
0.076ECEGPT-J-6B
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GPT-J-6BStructure=last cloze2026.01 | 0.076 | 0.453 | 0.374 | 0.432 | 0.076 | 0.085 | 0.066 | 0.715 | |
| DeepSeek-8BStructure=last cloze2026.01 | 0.085 | 0.461 | 0.369 | 0.47 | 0.09 | 0.074 | 0.106 | 0.686 | |
| Qwen2.5-7BStructure=last cloze2026.01 | 0.106 | 0.476 | 0.422 | 0.385 | 0.107 | 0.052 | 0.162 | 0.637 | |
| Llama-3.1-8BStructure=last cloze2026.01 | 0.111 | 0.466 | 0.371 | 0.446 | 0.111 | 0.112 | 0.109 | 0.727 | |
| Falcon3-7BStructure=last cloze2026.01 | 0.161 | 0.491 | 0.449 | 0.356 | 0.149 | 0.081 | 0.217 | 0.605 | |
| Gemma-2-9BStructure=last cloze2026.01 | 0.327 | 0.493 | 0.39 | 0.559 | 0.267 | 0.33 | 0.204 | 0.617 |