Question Answering on Musique (dev)
54.4EMRoHT_mix
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RoHT_mixInput modality=Text+KB2023.05 | 54.4 | 62.3 | — | — | |
| RoHT_textInput modality=Text2023.05 | 53.1 | 61.6 | — | — | |
| SEQGRAPHModel Size=Large2023.07 | 46.01 | 56.88 | 65.12 | 83.65 | |
| PATH-FIDModel Size=Large, Implementation Source=Our reimplementation2023.07 | 42.28 | 53.86 | 62.14 | 82.45 | |
| EX(SA)Input modality=Text2023.05 | 41.5 | 49.7 | — | — | |
| SAInput modality=Text2023.05 | 39.3 | 47.3 | — | — | |
| SEQGRAPHModel Size=Base2023.07 | 37.36 | 47.11 | 58.05 | 80.39 | |
| FIDModel Size=Large2023.07 | 36.04 | 46.66 | — | — | |
| PATH-FIDModel Size=Base2023.07 | 34.71 | 44.93 | 57.3 | 80.18 | |
| FIDModel Size=Base2023.07 | 29.38 | 39.97 | — | — | |
| TransferNetInput modality=Text+KB2023.05 | 8.6 | 10.9 | — | — |