Question Answering on COVID-QA (test)
5.8EMEXIT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| EXITReader=GPT-4o, Compression Type=Extractive2024.12 | 5.8 | 17.2 | 129.33 | |
| Original DocsReader=GPT-4o2024.12 | 3.8 | 16 | 1,775.66 | |
| RefinerReader=GPT-4o, Compression Type=Abstractive2024.12 | 3.8 | 14.6 | 201.38 | |
| CompActReader=GPT-4o, Compression Type=Abstractive2024.12 | 3.4 | 14.6 | 95.65 | |
| RECOMP-AbstReader=GPT-4o, Compression Type=Abstractive2024.12 | 2.2 | 11.5 | 17.94 | |
| LongLLMLinguaReader=GPT-4o, Compression Type=Extractive2024.12 | 2.2 | 13.5 | 353.03 | |
| RECOMP-ExtrReader=GPT-4o, Compression Type=Extractive2024.12 | 1.4 | 11.4 | 103.11 |