List your company
ResearchFormerly WizWand

Step-wise Confidence Attribution on MoreHopQA

0.8084AUROCGIBS
0.2238160.3755830.527350.679117May 19, 2026
Updated 5mo ago

Evaluation results

MethodLinks
GIBSLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.80840.835770.510.1832
NLI-MaxLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.66630.776664.570.1107
GIBSLLM=Phi4-reasoning2026.050.66190.686670.530.356
GIBSLLM=Llama3.1-8b2026.050.64710.669456.020.3173
NLI-MeanLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.62910.689964.980.4305
EntropyLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.61030.71568.120.0952
EntropyLLM=Phi4-reasoning2026.050.60120.670257.090.052
Cos-MeanLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.59380.691964.190.2434
NLI-MaxLLM=Phi4-reasoning2026.050.58010.663769.610.2323
EntropyLLM=Llama3.1-8b2026.050.5510.541355.860.2148
NLI-MeanLLM=Phi4-reasoning2026.050.5440.642867.760.461
P(true)LLM=Llama3.1-8b2026.050.52280.548654.50.5357
P(true)LLM=DeepSeek-R1-Distill-Qwen-32B2026.050.51770.649266.060.6443
NLI-MeanLLM=Llama3.1-8b2026.050.51240.553553.140.3902
P(true)LLM=Phi4-reasoning2026.050.50860.615963.620.6203
Cos-MeanLLM=Llama3.1-8b2026.050.50440.548752.750.316
NLI-MaxLLM=Llama3.1-8b2026.050.49370.548553.470.2159
Cos-MeanLLM=Phi4-reasoning2026.050.47790.649263.880.2023
SL(norm)LLM=Llama3.1-8b2026.050.40050.450651.870.3168
Cos-MaxLLM=Llama3.1-8b2026.050.38360.444651.790.3687
Cos-MaxLLM=Phi4-reasoning2026.050.34540.528464.130.2614
Cos-MaxLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.3390.512960.310.3066
LECOLLM=Llama3.1-8b2026.050.3280.436549.210.3501
SL(norm)LLM=Phi4-reasoning2026.050.31980.496658.910.2751
LECOLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.31160.577756.420.37
LECOLLM=Phi4-reasoning2026.050.2760.494457.820.4254
SL(norm)LLM=DeepSeek-R1-Distill-Qwen-32B2026.050.24630.489460.490.2829