Question Answering on MUSIQUE Answerable (test)
57.6Answer F1SEQGRAPH-SIA-Large
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SEQGRAPH-SIA-LargeModel Size=Large, Architecture=Single stage End-to-End, Output Mode=SIA (Title + Intermediate Answers)2023.07 | 57.6 | 78.4 | |
| PATH-FiD-SIA-LargeModel Size=Large, Output Mode=SIA (Title + Intermediate Answers)2023.07 | 54.8 | 77.9 | |
| Select+Answer (SA) ModelArchitecture=Two stage, Backbone=Roberta Large + Longformer Large2023.07 | 52.3 | 75.2 | |
| Step Execution by Select+Answer (EX(SA)) ModelMode=Step Execution2023.07 | 49 | 80.6 | |
| FiD-LargeModel Size=Large2023.07 | 48.4 | — | |
| Step Execution by End2End (EX(EE)) ModelMode=Step Execution2023.07 | 46.4 | 78.1 | |
| End2End (EE) ModelArchitecture=Single stage, Backbone=Longformer-Large2023.07 | 40.7 | 69.4 |