List your company
ResearchFormerly WizWand

Correctness Prediction on Medals

77AUROCDirection
48.9256.2163.570.79Sep 12, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DirectionModel=Llama 3.3 70B Instruct, Train dataset=TriviaQA2025.0977
DirectionModel=Llama 3.1 8B, Train dataset=TriviaQA2025.0968
DirectionModel=Ministral 8B Instruct 2410, Train dataset=TriviaQA2025.0967
Verb. conf.Model=Llama 3.3 70B Instruct2025.0966.5
DirectionModel=Mistral 7B Instruct v0.3, Train dataset=TriviaQA2025.0964.5
DirectionModel=DeepSeek R1 Distill Qwen 32B, Train dataset=TriviaQA2025.0963.8
AssessorModel=Mistral 7B Instruct v0.3, Assessor type=logistic regression2025.0963.8
AssessorModel=Ministral 8B Instruct 2410, Assessor type=logistic regression2025.0962.6
AssessorModel=Llama 3.1 8B, Assessor type=logistic regression2025.0962.3
AssessorModel=Qwen 2.5 7B Instruct, Assessor type=logistic regression2025.0962.2
AssessorModel=DeepSeek R1 Distill Qwen 32B, Assessor type=logistic regression2025.0960.1
DirectionModel=Qwen 2.5 7B Instruct, Train dataset=TriviaQA2025.0958.6
AssessorModel=Llama 3.3 70B Instruct, Assessor type=logistic regression2025.0956.8
Verb. conf.Model=DeepSeek R1 Distill Qwen 32B2025.0956.3
Verb. conf.Model=Mistral 7B Instruct v0.32025.0955.8
Verb. conf.Model=Qwen 2.5 7B Instruct2025.0953.1
Verb. conf.Model=Ministral 8B Instruct 24102025.0950.2
Verb. conf.Model=Llama 3.1 8B2025.0950