RAG Performance Prediction on HotpotQA
0.78QE5Bert-Gen
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Bert-GenLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.78 | 0.715 | 0.523 | |
| Bert-GenLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.779 | 0.697 | 0.521 | |
| Bert-GenLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.744 | 0.609 | 0.59 | |
| Bert-GenLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.733 | 0.562 | 0.599 | |
| Bert-PostLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.486 | 0.233 | 0.267 | |
| Bert-PostLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.484 | 0.288 | 0.327 | |
| UncertaintyLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.419 | 0.006 | 0.196 | |
| UncertaintyLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.385 | -0.035 | 0.134 | |
| Bert-PostLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.375 | 0.324 | 0.405 | |
| UncertaintyLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.371 | 0.212 | 0.28 | |
| Bert-PostLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.37 | 0.328 | 0.378 | |
| UncertaintyLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.358 | 0.198 | 0.245 | |
| EntailmentLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.258 | 0.122 | 0.15 | |
| REFLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.255 | 0.146 | 0.203 | |
| EntailmentLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.233 | 0.112 | 0.106 | |
| U_WIGLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.19 | 0.121 | 0.135 | |
| U_SMVLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.181 | 0.118 | 0.106 | |
| WIGLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.18 | 0.117 | 0.116 | |
| SMVLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.18 | 0.115 | 0.105 | |
| U_WIGLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.176 | 0.065 | 0.063 | |
| REFLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.173 | 0.176 | 0.213 | |
| REFLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.167 | 0.099 | 0.101 | |
| QCLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.16 | 0.089 | 0.069 | |
| NQCLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.159 | 0.086 | 0.068 | |
| REFLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.124 | 0.101 | 0.143 | |
| U_WIGLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.122 | 0.107 | 0.143 | |
| QCLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.12 | 0.083 | 0.091 | |
| U_SMVLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.12 | 0.083 | 0.091 | |
| U_WIGLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.118 | 0.096 | 0.144 | |
| EntailmentLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.116 | 0.091 | 0.173 | |
| QCLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.112 | 0.106 | 0.136 | |
| NQCLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.104 | 0.087 | 0.124 | |
| EntailmentLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.103 | 0.092 | 0.153 | |
| QCLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.102 | 0.086 | 0.125 | |
| U_SMVLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.091 | 0.081 | 0.108 | |
| WIGLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.089 | 0.095 | 0.124 | |
| SMVLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.081 | 0.063 | 0.054 | |
| NQCLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.08 | 0.063 | 0.054 | |
| meanSCQLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.073 | 0.051 | 0.053 | |
| NQCLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.067 | 0.107 | 0.107 | |
| SMVLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.067 | 0.107 | 0.107 | |
| SMVLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.05 | 0.077 | 0.117 | |
| U_SMVLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.049 | 0.076 | 0.118 | |
| maxSCQLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.044 | 0.027 | 0.051 | |
| maxVARLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.042 | 0.065 | 0.025 | |
| maxVARLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.04 | 0.06 | 0.057 | |
| maxSCQLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.039 | 0.054 | 0.058 | |
| maxIDFLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.038 | 0.062 | 0.048 | |
| meanSCQLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.038 | 0.037 | 0.055 | |
| minVARLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.035 | 0.03 | 0.012 | |
| maxIDFLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.031 | 0.06 | 0.047 | |
| maxSCQLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.03 | 0.023 | 0.024 | |
| maxSCQLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.029 | 0.031 | 0.039 | |
| minVARLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.023 | 0.006 | 0.029 | |
| minSCQLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.02 | 0.021 | 0.017 | |
| meanSCQLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0.019 | 0.036 | 0.036 | |
| meanIDFLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.018 | 0.049 | 0.033 | |
| meanVARLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.015 | 0.053 | 0.015 | |
| minIDFLLM=Llama, Retrieval Method=BM25 Retrieval2026.04 | 0.013 | 0.018 | 0.013 | |
| meanSCQLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.013 | 0.023 | 0.044 | |
| minVARLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.01 | 0.01 | 0.029 | |
| WIGLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.008 | -0.012 | -0.018 | |
| minSCQLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.007 | 0.014 | 0.033 | |
| maxVARLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | 0.007 | 0.034 | 0.004 | |
| maxVARLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | 0.002 | 0.028 | 0.012 | |
| minVARLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | 0 | -0.001 | 0.004 | |
| minIDFLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | -0.002 | 0.013 | 0.025 | |
| meanVARLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | -0.007 | 0.03 | 0.016 | |
| minSCQLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | -0.007 | 0.007 | 0.024 | |
| meanIDFLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | -0.013 | 0.03 | 0.009 | |
| minSCQLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | -0.013 | -0.001 | 0.001 | |
| minIDFLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | -0.015 | 0.002 | 0.021 | |
| maxIDFLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | -0.017 | 0.007 | -0.018 | |
| minIDFLLM=Falcon, Retrieval Method=BM25 Retrieval2026.04 | -0.022 | -0.007 | -0.001 | |
| WIGLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | -0.027 | 0.006 | 0.033 | |
| meanVARLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | -0.033 | 0.017 | -0.009 | |
| meanVARLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | -0.038 | 0.007 | -0.01 | |
| maxIDFLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | -0.039 | 0.004 | -0.007 | |
| meanIDFLLM=Llama, Retrieval Method=E5 Retrieval2026.04 | -0.041 | 0.009 | 0.003 | |
| meanIDFLLM=Falcon, Retrieval Method=E5 Retrieval2026.04 | -0.042 | -0.001 | -0.024 |