Open-Domain Question Answering on TQA (test)
66.45EMECoRAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ECoRAGReader Model=Flan-UL2, #tokens=5012025.06 | 66.45 | 74.02 | |
| LongLLMLinguaReader Model=Flan-UL2, #tokens=15702025.06 | 65.79 | 73.88 | |
| ECoRAG#tokens=441, Backbone=GPT-4o-mini2025.06 | 65.34 | 75.37 | |
| BGE-M3Top-k retrieval=20, #tokens=746, Backbone=GPT-4o-mini2025.06 | 65.15 | 75.14 | |
| CompActReader Model=Flan-UL2, #tokens=2532025.06 | 64.37 | 72.25 | |
| BGE-M3Top-k retrieval=10, #tokens=370, Backbone=GPT-4o-mini2025.06 | 64.12 | 74.34 | |
| RECOMP (extractive)Reader Model=Flan-UL2, #tokens=7502025.06 | 62.49 | 69.68 | |
| LLMLingua-2Reader Model=Flan-UL2, #tokens=15182025.06 | 53.07 | 59.42 | |
| closed-bookReader Model=Flan-UL2, #tokens=02025.06 | 46.48 | 52.47 | |
| RECOMP (abstractive)Reader Model=Flan-UL2, #tokens=302025.06 | 43.5 | 49.88 | |
| LLMLinguaReader Model=Flan-UL2, #tokens=7262025.06 | 42.97 | 48.93 |