List your company

Knowledge composition selection on 2WikiMultihopQA

100Precision @ K=2BASE
4.94429.62254.378.978Aug 28, 2025

Evaluation results

MethodLinks
BASEType=MAX2025.0810089.6893.1273.5594.8581.19
KCSBase Model=BERT-base2025.0884.7975.1878.3966.2184.6672.75
CLSBase Model=BERT-base2025.0879.969.6873.0965.0682.5571.2
KCSBase Model=BERT-large2025.0875.3466.6569.5556.5474.4463.11
KCSBase Model=RoBERTa-large2025.0874.2165.7468.5655.5873.7562.3
CLSBase Model=BERT-large2025.0873.2564.2567.2561.57967.74
RETRIEVALBase Model=BM25, Execution=+step by step2025.0853.947.9649.9441.2954.4446.12
SENTENCE GRAPHStrategy=CommonEntity2025.0851.245.2447.2337.0948.6841.33
RETRIEVALBase Model=bge-large-v1.5, Execution=+step by step2025.0850.9143.5846.0340.6752.2444.8
LLMBase Model=GPT-4, prompt_mode=zero-shot2025.0849.7443.5945.6440.152.5644.65
RETRIEVALBase Model=BM252025.0848.143.4244.9835.147.3839.71
LLMBase Model=DeepSeek-V3, prompt_mode=zero-shot2025.0845.7740.1542.0237.9650.0942.43
CLSBase Model=RoBERTa-large2025.0844.7536.8839.537.8346.2540.6
RETRIEVALBase Model=bge-large-v1.52025.0844.0239.1240.7533.4744.7337.66
RETRIEVALBase Model=text-ada-0022025.0842.2937.4139.0331.6542.1435.54
SENTENCE GRAPHStrategy=Similarity2025.0841.6237.8739.1227.8838.0731.74
RETRIEVALBase Model=bge-m32025.0841.0636.5338.0430.5541.0234.47
RETRIEVALBase Model=bge-small2025.0840.0435.537.0230.6941.0134.53
LLMBase Model=Qwen2.5-7B, prompt_mode=zero-shot2025.0825.0521.5822.7419.6125.221.61
LLMBase Model=Qwen2.5-14B, prompt_mode=zero-shot2025.0819.2416.0917.1416.6820.8418.11
LLMBase Model=Llama3.2-3B, prompt_mode=zero-shot2025.0813.7310.9111.8511.711412.42
LLMBase Model=Llama3.1-8B, prompt_mode=zero-shot2025.0810.968.849.5510.6112.8511.33
BASEType=Random2025.088.66.957.59.0110.969.64