List your company
ResearchFormerly WizWand

Classification Calibration on HellaSwag

2.38ECECaliDist (Pr.)
0.68812.10923.5334.951Jun 4, 2026
Updated 4mo ago

Evaluation results

MethodLinks
CaliDist (Pr.)LLM=Gemma-3 (4B)2026.062.3823.97
CaliDist (As.)LLM=Gemma-3 (4B)2026.062.8924.69
CaliDist (Sa.)LLM=Gemma-3 (4B)2026.063.0824.08
Temperature ScalingLLM=Phi-4-mini (3.8B)2026.063.518.65
CaliDist (As.)LLM=Phi-4-mini (3.8B)2026.065.7518.9
CaliDist (Sa.)LLM=Phi-4-mini (3.8B)2026.065.7818.91
CaliDist (Pr.)LLM=Phi-4-mini (3.8B)2026.066.0918.93
VanillaLLM=Phi-4-mini (3.8B)2026.068.819.31
ConsistencyLLM=Phi-4-mini (3.8B)2026.0611.6920.96
FSDLLM=Phi-4-mini (3.8B)2026.0613.4822.43
EntropyLLM=Phi-4-mini (3.8B)2026.0625.2327.64
Temperature ScalingLLM=Gemma-3 (4B)2026.0641.641.73
EntropyLLM=Gemma-3 (4B)2026.0643.3243.79
FSDLLM=Gemma-3 (4B)2026.0643.6144.05
ConsistencyLLM=Gemma-3 (4B)2026.0644.6444.55
VanillaLLM=Gemma-3 (4B)2026.0644.6844.55