End-to-end Question Answering on HotpotQA ANCE
49.6MAP@10ACQO
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ACQOReader Model=Qwen2.5-7B-Instruct, Evaluation Judge=DeepSeek-R1, Retriever=ANCE, Top-k Context=102026.01 | 49.6 | 31.6 | 15.2 | |
| ConvSearch-R1Reader Model=Qwen2.5-7B-Instruct, Evaluation Judge=DeepSeek-R1, Retriever=ANCE, Top-k Context=102026.01 | 44.4 | 27.7 | 11.3 | |
| Raw QueryReader Model=Qwen2.5-7B-Instruct, Evaluation Judge=DeepSeek-R1, Retriever=ANCE, Top-k Context=102026.01 | 34.8 | 16.4 | — |