Question Answering on HQA (val)
35.2EMEXIT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| EXITType=Ext., Retriever=BM25, Retrieval Documents=Top-202024.12 | 35.2 | 46.9 | 411.3 | 13.7 | |
| EXITType=Ext., Retriever=BM25, Retrieval Documents=Top-52024.12 | 33.4 | 44.5 | 177.8 | 23.5 | |
| CompActType=Abs., Retriever=BM25, Retrieval Documents=Top-202024.12 | 31.6 | 43 | 109.5 | 3.6 | |
| Original DocsType=None, Retriever=BM25, Retrieval Documents=Top-202024.12 | 31.2 | 42.5 | 3,009.5 | 100 | |
| LongLLMLinguaType=Ext., Retriever=BM25, Retrieval Documents=Top-202024.12 | 31 | 40.7 | 558 | 18.5 | |
| RefinerType=Abs., Retriever=BM25, Retrieval Documents=Top-52024.12 | 30.8 | 42.3 | 84 | 11.1 | |
| CompActType=Abs., Retriever=BM25, Retrieval Documents=Top-52024.12 | 30.6 | 41.2 | 76.9 | 10.2 | |
| RECOMP-AbstType=Abs., Retriever=BM25, Retrieval Documents=Top-202024.12 | 29 | 39.7 | 69.7 | 2.3 | |
| LongLLMLinguaType=Ext., Retriever=BM25, Retrieval Documents=Top-52024.12 | 28.6 | 39.7 | 230.3 | 30.5 | |
| RefinerType=Abs., Retriever=BM25, Retrieval Documents=Top-202024.12 | 28.4 | 38.8 | 136.1 | 4.5 | |
| RECOMP-ExtrType=Ext., Retriever=BM25, Retrieval Documents=Top-202024.12 | 28.4 | 37 | 93.5 | 3.1 | |
| Original DocsType=None, Retriever=BM25, Retrieval Documents=Top-52024.12 | 28.2 | 39.1 | 755.8 | 100 | |
| RECOMP-ExtrType=Ext., Retriever=BM25, Retrieval Documents=Top-52024.12 | 28.2 | 37.5 | 93.1 | 12.3 | |
| RECOMP-AbstType=Abs., Retriever=BM25, Retrieval Documents=Top-52024.12 | 27.8 | 39.2 | 63 | 8.3 |