Question Answering on WebQ
37.76Exact Matchdual-debiasing framework
Evaluation Results
| Method | Links | |
|---|---|---|
| dual-debiasing frameworkRetriever=TopK, Noise Type=Irrelevant, Noise Ratio=0.22025.05 | 37.76 | |
| dual-debiasing frameworkRetriever=DPP, Noise Type=None, Noise Ratio=0.02025.05 | 37.04 | |
| DPP + LPRBackbone=Llama-2-7B-Chat, Noise Type=Relevant Noise, Noise Ratio=60%2024.05 | 21.35 | |
| TopK + LPRBackbone=Llama-2-7B-Chat, Noise Type=Relevant Noise, Noise Ratio=60%2024.05 | 21.28 | |
| RandomBackbone=Llama-2-7B-Chat, Noise Type=Clean, Noise Ratio=0%2024.05 | 20.37 | |
| Random + LPRBackbone=Llama-2-7B-Chat, Noise Type=Irrelevant Noise, Noise Ratio=60%2024.05 | 12.54 | |
| Naïve ICLRetriever=DPP, Noise Type=Relevant, Noise Ratio=0.82025.05 | 5.99 |