List your company

Information Retrieval on QUEST (test)

30.8P@1OrLog
10.83216.01621.226.384Jan 30, 2026

Evaluation results

MethodLinks
OrLogBase Retriever=E5, Reasoning Strategy=OrLog, Knowledge Setting=Parametric+, Backbone Model=Llama-3.3-70B-Instruct2026.0130.813.13.914.26.312.130.819.738.4
LLMBase Retriever=E5, Reasoning Strategy=LLM-as-reasoner, Knowledge Setting=Parametric+, Backbone Model=Llama-3.3-70B-Instruct2026.0126.313.33.414.55.612.326.319.335.5
LLM*Base Retriever=E5, Reasoning Strategy=Logic-augmented LLM, Knowledge Setting=Parametric+, Backbone Model=Llama-3.3-70B-Instruct2026.0124.112.73.113.8511.824.11833.3
OrLogBase Retriever=BM25, Reasoning Strategy=OrLog, Knowledge Setting=Parametric+, Backbone Model=Llama-3.3-70B-Instruct2026.0122.18.92.69.54.48.222.113.426.7
LLM*Base Retriever=E5, Reasoning Strategy=Logic-augmented LLM, Knowledge Setting=Parametric, Backbone Model=Llama-3.3-70B-Instruct2026.0120.411.92.413.24.111.120.416.329.9
LLMBase Retriever=E5, Reasoning Strategy=LLM-as-reasoner, Knowledge Setting=Parametric, Backbone Model=Llama-3.3-70B-Instruct2026.0119.211.52.312.63.810.719.215.628.7
LLMBase Retriever=BM25, Reasoning Strategy=LLM-as-reasoner, Knowledge Setting=Parametric+, Backbone Model=Llama-3.3-70B-Instruct2026.0118.58.62.39.33.8818.512.524.4
E5Base Retriever=E5, Reasoning Strategy=Original Ranking2026.0118.210.52.111.63.59.818.214.226.9
OrLogBase Retriever=E5, Reasoning Strategy=OrLog, Knowledge Setting=Parametric, Backbone Model=Llama-3.3-70B-Instruct2026.0116.110.41.911.43.19.716.113.626
LLM*Base Retriever=BM25, Reasoning Strategy=Logic-augmented LLM, Knowledge Setting=Parametric, Backbone Model=Llama-3.3-70B-Instruct2026.0115.88.31.98.83.17.715.811.421.9
LLMBase Retriever=BM25, Reasoning Strategy=LLM-as-reasoner, Knowledge Setting=Parametric, Backbone Model=Llama-3.3-70B-Instruct2026.0115.57.928.53.27.415.51121.2
LLM*Base Retriever=BM25, Reasoning Strategy=Logic-augmented LLM, Knowledge Setting=Parametric+, Backbone Model=Llama-3.3-70B-Instruct2026.0114.47.61.98.337.114.410.620.3
OrLogBase Retriever=BM25, Reasoning Strategy=OrLog, Knowledge Setting=Parametric, Backbone Model=Llama-3.3-70B-Instruct2026.0113.87.51.582.6713.810.119.9
BM25Base Retriever=BM25, Reasoning Strategy=Original Ranking2026.0111.66.71.47.32.26.211.68.917.5