Multi-hop Question Answering on HotpotQA (EM, TFR, FFR, F1, IB)
26.1EMInformation Bottleneck (IB)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Information Bottleneck (IB)words=13.22024.06 | 26.1 | 22.1 | 14.3 | 58.3 | -4.47 | |
| LLAMA2words=27.72024.06 | 25.9 | 31.1 | 16.2 | 57.8 | -4.44 | |
| LONGLLMLINGUAwords=137.72024.06 | 23.9 | 32.7 | 14 | 56.4 | -4.19 | |
| RANKGPTwords=102.92024.06 | 23.5 | 34.1 | 13.9 | 57.2 | -4.39 | |
| Top 1 documentwords=102.92024.06 | 23.2 | 31.1 | 12.8 | 57.3 | -4.36 | |
| LLAMA2-13Bwords=02024.06 | 18.5 | — | — | 53.6 | -4.21 | |
| Top 5 documentswords=514.72024.06 | 18.3 | 50.7 | 11.2 | 50.2 | -4.1 |