Coreference Resolution on XWinograd
79.9AccuracyLANG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LANGbackbone=Qwen2.5-7B-Instruct2026.05 | 79.9 | 79.9 | |
| BYOL-nyaParameters=12B, Pre-training Type=CPT2026.01 | 70.37 | — | |
| HQ seedFiltering Strategy=HQ seed2026.04 | 69.64 | — | |
| MKC-eFiltering Strategy=MKC-e2026.04 | 69.25 | — | |
| ML (15%)Filtering Strategy=ML (15%)2026.04 | 68.65 | — | |
| BYOL-nyaParameters=4B, Pre-training Type=CPT2026.01 | 68.34 | — | |
| HQFiltering Strategy=HQ2026.04 | 68.25 | — | |
| No filteringFiltering Strategy=No filtering2026.04 | 68.06 | — | |
| MLFiltering Strategy=ML2026.04 | 67.66 | — | |
| ML (Q3)Filtering Strategy=ML (Q3)2026.04 | 66.67 | — | |
| Qwen2.5-7B-Instruct2026.05 | 65.7 | 65.7 | |
| Vanilla GRPObackbone=Qwen2.5-7B-Instruct2026.05 | 65.7 | 65.7 | |
| BYOL-nyaParameters=1B, Pre-training Type=CPT2026.01 | 63.32 | — | |
| BYOL-mriParameters=12B, Training Stage=CPT2026.01 | 62.67 | — | |
| LC-GRPObackbone=Qwen2.5-7B-Instruct2026.05 | 62.2 | 62.2 | |
| Gemma-3Parameters=12B, Pre-training Type=PT2026.01 | 61.39 | — | |
| BYOL-mriParameters=4B, Training Stage=CPT2026.01 | 59.68 | — | |
| BYOL-mriParameters=1B, Training Stage=CPT2026.01 | 57.33 | — | |
| ApertusParameters=8B, Pre-training Type=25092026.01 | 56.15 | — | |
| Gemma-3Parameters=4B, Pre-training Type=PT2026.01 | 54.76 | — | |
| Qwen-3Parameters=8B, Pre-training Type=Base2026.01 | 52.09 | — | |
| Gemma-3Parameters=1B, Pre-training Type=PT2026.01 | 51.34 | — | |
| Qwen-3Parameters=14B, Pre-training Type=Base2026.01 | 51.12 | — | |
| Llama-3.2Parameters=1B2026.01 | 50.59 | — | |
| Llama-3.1Parameters=8B2026.01 | 50.59 | — | |
| Qwen-3Parameters=1.7B, Pre-training Type=Base2026.01 | 49.2 | — |