Multi-hop Question Answering on MuSiQue (val test)
15.1EMSetCE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SetCEBase=Qwen3, Latency (sec/query)=0.5852026.07 | 15.1 | 23.8 | |
| CE10Base=Qwen3, Latency (sec/query)=0.1142026.07 | 14.4 | 22.7 | |
| (ParaSet+SetCE)+CE5Base=Qwen3, Latency (sec/query)=0.2412026.07 | 14.4 | 22.7 | |
| ListCEBase=Qwen3, Latency (sec/query)=0.5852026.07 | 14.2 | 22.6 | |
| ParaSet+SetCEBase=Qwen3, Latency (sec/query)=0.1642026.07 | 14.2 | 24.1 | |
| CE5Base=Qwen3, Latency (sec/query)=0.1142026.07 | 13.4 | 21.1 | |
| BiBase=Qwen3, Latency (sec/query)=0.0732026.07 | 12.6 | 20.2 | |
| (ParaSet+SetCE)+CE5Base=Contriever, Latency (sec/query)=0.1962026.07 | 9.3 | 15.7 | |
| SetCEBase=Contriever, Latency (sec/query)=0.5552026.07 | 8.98 | 16.2 | |
| CE10Base=Contriever, Latency (sec/query)=0.0672026.07 | 8.89 | 14.8 | |
| CE5Base=Contriever, Latency (sec/query)=0.0672026.07 | 8.53 | 15.9 | |
| BiBase=Contriever, Latency (sec/query)=0.0322026.07 | 8.45 | 15.6 | |
| ListCEBase=Contriever, Latency (sec/query)=0.5552026.07 | 8.07 | 15.4 | |
| ParaSet+SetCEBase=Contriever, Latency (sec/query)=0.1162026.07 | 7.3 | 14.1 |