End-to-end Question Answering on OTT-QA
0.317AccuracyARM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ARMGeneration model=GPT4o mini2025.01 | 0.317 | 0.491 | 0.591 | |
| DRR@5Generation model=GPT4o mini, top-k=52025.01 | 0.298 | 0.459 | 0.552 | |
| DR@5Generation model=GPT4o mini, top-k=52025.01 | 0.297 | 0.4 | 0.478 | |
| DRR-D@5Generation model=GPT4o mini, top-k=5, query decomposition=true2025.01 | 0.265 | 0.456 | 0.554 | |
| ReActGeneration model=GPT4o mini2025.01 | 0.254 | 0.407 | 0.493 | |
| DR-D@5Generation model=GPT4o mini, top-k=5, query decomposition=true2025.01 | 0.238 | 0.326 | 0.397 |