Question Answering on 2WIKI (val)
27.2EMEXIT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| EXITType=Ext., Retriever=BM25, Retrieval Documents=Top-202024.12 | 27.2 | 32.4 | 312.7 | 10 | |
| RECOMP-AbstType=Abs., Retriever=BM25, Retrieval Documents=Top-52024.12 | 25 | 30.6 | 55.7 | 7.1 | |
| EXITType=Ext., Retriever=BM25, Retrieval Documents=Top-52024.12 | 24.4 | 29.1 | 138.2 | 17.5 | |
| LongLLMLinguaType=Ext., Retriever=BM25, Retrieval Documents=Top-202024.12 | 23.6 | 28.3 | 593.7 | 19 | |
| Original DocsType=None, Retriever=BM25, Retrieval Documents=Top-202024.12 | 23 | 30.6 | 3,132.5 | 100 | |
| RECOMP-AbstType=Abs., Retriever=BM25, Retrieval Documents=Top-202024.12 | 22.8 | 28.2 | 52.3 | 1.7 | |
| LongLLMLinguaType=Ext., Retriever=BM25, Retrieval Documents=Top-52024.12 | 22.2 | 27.4 | 236.6 | 30 | |
| CompActType=Abs., Retriever=BM25, Retrieval Documents=Top-202024.12 | 20.4 | 28.7 | 113.2 | 3.6 | |
| Original DocsType=None, Retriever=BM25, Retrieval Documents=Top-52024.12 | 19.6 | 25.9 | 789.7 | 100 | |
| CompActType=Abs., Retriever=BM25, Retrieval Documents=Top-52024.12 | 19.6 | 29.1 | 71 | 9 | |
| RefinerType=Abs., Retriever=BM25, Retrieval Documents=Top-52024.12 | 19.6 | 27.8 | 62.9 | 8 | |
| RefinerType=Abs., Retriever=BM25, Retrieval Documents=Top-202024.12 | 18.8 | 26.9 | 108.4 | 3.5 | |
| RECOMP-ExtrType=Ext., Retriever=BM25, Retrieval Documents=Top-52024.12 | 11.8 | 19.1 | 99.1 | 12.5 | |
| RECOMP-ExtrType=Ext., Retriever=BM25, Retrieval Documents=Top-202024.12 | 11.2 | 19.3 | 96.7 | 3.1 |