Coreference Resolution Calibration Evaluation on WinoQueer
27.7GayDeepSeek-8B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DeepSeek-8BParameters=8B2026.01 | 27.7 | 83.8 | 25.8 | 91 | |
| Qwen2.5-7BParameters=7B2026.01 | 18.9 | 89.8 | 91.9 | 78.8 | |
| GPT-J-6BParameters=6B2026.01 | 12.1 | 79 | 81.6 | 70 | |
| Llama-3.1-8BParameters=8B2026.01 | 8.3 | 73 | 76 | 65.7 | |
| Falcon3-7BParameters=7B2026.01 | 5.9 | 71.5 | 68.6 | 43.2 | |
| Gemma-2-9BParameters=9B2026.01 | 2.6 | 22.1 | 58.6 | 18.2 |