List your company
ResearchFormerly WizWand

Step-wise Confidence Attribution on GSM8K

0.7892AUROCGIBS
0.2684720.4036610.538850.674039May 19, 2026
Updated 5mo ago

Evaluation results

MethodLinks
GIBSLLM=Phi4-reasoning2026.050.78920.817281.170.3354
NLI-MaxLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.7450.698264.090.1456
GIBSLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.72890.671265.320.2867
NLI-MaxLLM=Llama3.1-8b2026.050.70960.78959.080.1162
GIBSLLM=Llama3.1-8b2026.050.6910.700462.920.2293
NLI-MeanLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.67620.650863.180.4189
Cos-MeanLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.66330.693357.480.3323
NLI-MaxLLM=Phi4-reasoning2026.050.660.814174.460.2009
Cos-MeanLLM=Llama3.1-8b2026.050.60780.621161.750.33
Cos-MeanLLM=Phi4-reasoning2026.050.59590.770371.990.1556
NLI-MeanLLM=Phi4-reasoning2026.050.57380.770471.860.5527
NLI-MeanLLM=Llama3.1-8b2026.050.55240.610356.650.4376
Cos-MaxLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.52690.519756.760.3799
P(true)LLM=Phi4-reasoning2026.050.52510.695669.340.6851
EntropyLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.52030.55552.350.2583
P(true)LLM=DeepSeek-R1-Distill-Qwen-32B2026.050.51590.58258.40.5802
SL(norm)LLM=Llama3.1-8b2026.050.4790.52455.130.2282
EntropyLLM=Phi4-reasoning2026.050.46230.679566.640.1648
Cos-MaxLLM=Llama3.1-8b2026.050.45370.515255.130.378
EntropyLLM=Llama3.1-8b2026.050.41050.496251.410.2518
P(true)LLM=Llama3.1-8b2026.050.40160.471152.830.5504
LECOLLM=Llama3.1-8b2026.050.38620.458653.190.3783
SL(norm)LLM=Phi4-reasoning2026.050.38510.594767.990.2394
SL(norm)LLM=DeepSeek-R1-Distill-Qwen-32B2026.050.370.530852.620.123
Cos-MaxLLM=Phi4-reasoning2026.050.34940.586170.10.1997
LECOLLM=DeepSeek-R1-Distill-Qwen-32B2026.050.32020.41148.830.3395
LECOLLM=Phi4-reasoning2026.050.28850.573563.440.4021