List your company

Answer Correctness Prediction on MedMCQA (val)

0.79Head EntropyHEAD ENTROPY
0.75050.770250.790.80975Feb 14, 2026

Evaluation results

MethodLinks
HEAD ENTROPYprediction_input=Question tokens only, prediction_stage=Pre-generation, aggregation=Average across Llama-3.2-3B-Instruct, Llama-3.1-8B-Instruct, Qwen3-1.7B, Qwen3-8B, Qwen3-32B2026.020.79—0.18
Hidden State LRprediction_input=Question tokens only, prediction_stage=Pre-generation, aggregation=Average across Llama-3.2-3B-Instruct, Llama-3.1-8B-Instruct, Qwen3-1.7B, Qwen3-8B, Qwen3-32B2026.02—0.62—