Open-domain question answering on MKQA Target Language (test)
40.64NOB AccuracySDRRL
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SDRRL2024.02 | 40.64 | 40.92 | 39.71 | 39.02 | 39.51 | 34.06 | 41.12 | 40.02 | 39.45 | 39.38 | |
| CIT2024.02 | 40.18 | 39.94 | 37.94 | 38.4 | 33.5 | 34.24 | 39.86 | 39.94 | 38.84 | 38.09 | |
| T-SFT2024.02 | 39.73 | 39.59 | 38.95 | 38.6 | 33.96 | 33.9 | 39.93 | 38.71 | 38.14 | 37.95 | |
| XCOT2024.02 | 39.03 | 39.28 | 38.12 | 35.6 | 33.07 | 33.69 | 39.96 | 39.49 | 38.49 | 37.41 | |
| SFT2024.02 | 37.3 | 38.28 | 37.3 | 35.21 | 32.8 | 33.18 | 39.29 | 37.5 | 37.5 | 36.48 |