Winograd Schema Challenge on XWINO
0.642AccuracyXGLM7.5B
Evaluation Results
| Method | Links | |
|---|---|---|
| XGLM7.5Bk-shot=42022.04 | 0.642 | |
| XGLM7.5Bk-shot=12022.04 | 0.637 | |
| mGPT13Bk-shot=42022.04 | 0.618 | |
| mGPT13Bk-shot=12022.04 | 0.61 | |
| mGPT13Bk-shot=02022.04 | 0.593 | |
| mGPT13Bk-shot=162022.04 | 0.592 | |
| XGLM7.5Bk-shot=02022.04 | 0.592 | |
| XGLM1.7Bk-shot=12022.04 | 0.58 | |
| XGLM1.7Bk-shot=42022.04 | 0.579 | |
| mGPT1.3Bk-shot=12022.04 | 0.57 | |
| mGPT1.3Bk-shot=42022.04 | 0.568 | |
| mGPT1.3Bk-shot=02022.04 | 0.562 | |
| mGPT1.3Bk-shot=162022.04 | 0.545 | |
| XGLM1.7Bk-shot=02022.04 | 0.542 |