List your company
ResearchFormerly WizWand

Question Answering on WebQ

37.76Exact Matchdual-debiasing framework
4.719213.297121.87530.4529May 27, 2024Jul 27, 2024Sep 27, 2024Nov 27, 2024Jan 28, 2025Mar 30, 2025May 31, 2025
Updated 8mo ago

Evaluation results

MethodLinks
dual-debiasing frameworkRetriever=TopK, Noise Type=Irrelevant, Noise Ratio=0.22025.0537.76
dual-debiasing frameworkRetriever=DPP, Noise Type=None, Noise Ratio=0.02025.0537.04
DPP + LPRBackbone=Llama-2-7B-Chat, Noise Type=Relevant Noise, Noise Ratio=60%2024.0521.35
TopK + LPRBackbone=Llama-2-7B-Chat, Noise Type=Relevant Noise, Noise Ratio=60%2024.0521.28
RandomBackbone=Llama-2-7B-Chat, Noise Type=Clean, Noise Ratio=0%2024.0520.37
Random + LPRBackbone=Llama-2-7B-Chat, Noise Type=Irrelevant Noise, Noise Ratio=60%2024.0512.54
Naïve ICLRetriever=DPP, Noise Type=Relevant, Noise Ratio=0.82025.055.99