List your company
ResearchFormerly WizWand

Calibration on CSQA

1.04ECECaliDist (Pr.)
0.46084.37048.2812.1896Jun 4, 2026
Updated 4mo ago

Evaluation results

MethodLinks
CaliDist (Pr.)LLM Model=GPT-4O-MINI, Confidence Type=Log-Prob.2026.061.0410.07
CaliDist (As.)LLM Model=GEMINI-2.0-FLASH, Confidence Type=Log-Prob.2026.062.3910.89
CaliDist (Sa.)LLM Model=GPT-4O-MINI, Confidence Type=Log-Prob.2026.063.4210.84
CaliDist (Sa.)LLM Model=GEMINI-2.0-FLASH, Confidence Type=Log-Prob.2026.063.4411.36
CaliDist (As.)LLM Model=GPT-4O-MINI, Confidence Type=Log-Prob.2026.064.7111.51
CaliDist (Pr.)LLM Model=GEMINI-2.0-FLASH, Confidence Type=Log-Prob.2026.065.1910.71
CaliDistverb. (Sa.)LLM Model=GPT-4O-MINI, Confidence Type=Verbalized2026.067.5513.27
CaliDistverb. (Pr.)LLM Model=GPT-4O-MINI, Confidence Type=Verbalized2026.067.6213.38
VerbalizedLLM Model=GPT-4O-MINI, Confidence Type=Verbalized2026.068.513.08
CaliDistverb. (As.)LLM Model=GPT-4O-MINI, Confidence Type=Verbalized2026.068.5913.03
VerbalizedLLM Model=GEMINI-2.0-FLASH, Confidence Type=Verbalized2026.0610.5613.01
CaliDistverb. (Pr.)LLM Model=GEMINI-2.0-FLASH, Confidence Type=Verbalized2026.0610.5613.01
CaliDistverb. (Sa.)LLM Model=GEMINI-2.0-FLASH, Confidence Type=Verbalized2026.0610.5613.01
CaliDistverb. (As.)LLM Model=GEMINI-2.0-FLASH, Confidence Type=Verbalized2026.0611.512.88
FSDLLM Model=GEMINI-2.0-FLASH, Confidence Type=Consistency2026.0612.1812.8
EntropyLLM Model=GEMINI-2.0-FLASH, Confidence Type=Consistency2026.0612.4913.03
VanillaLLM Model=GEMINI-2.0-FLASH, Confidence Type=Log-Prob.2026.0612.8213.08
ConsistencyLLM Model=GEMINI-2.0-FLASH, Confidence Type=Consistency2026.0612.9713.21
VanillaLLM Model=GPT-4O-MINI, Confidence Type=Log-Prob.2026.0613.8714.21
FSDLLM Model=GPT-4O-MINI, Confidence Type=Consistency2026.0614.9515.82
EntropyLLM Model=GPT-4O-MINI, Confidence Type=Consistency2026.0615.316
ConsistencyLLM Model=GPT-4O-MINI, Confidence Type=Consistency2026.0615.5216.07