Automated Short Answer Scoring on ASAP-SAS (test) benchmark leaderboard · SOTA2 Research

Automated Short Answer Scoring on ASAP-SAS (test)

0.95Score Q1Human Scorers

Evaluation Results

Method	Links
Human Scorers2025.11		0.95	0.93	0.77	0.75	0.95	0.93	0.96	0.86	0.84	0.87	0.88	0.93	0.79	0.91
Llama-3.1-8b (Instruct)2025.11		0.87	0.8	0.68	0.77	0.85	0.8	0.72	0.65	0.84	0.79	0.78	0.82	0.76	0.68
DeBERTa2025.11		0.85	0.86	0.66	0.7	0.81	0.83	0.71	0.64	0.79	0.71	0.76	0.81	0.72	0.67
Llama-3.1-8b (Instruct)2025.11		0.84	0.73	0.72	0.71	0.82	0.81	0.71	0.66	0.82	0.75	0.76	0.79	0.75	0.69
Llama-3.1-8b2025.11		0.83	0.75	0.7	0.77	0.82	0.84	0.68	0.65	0.82	0.74	0.76	0.8	0.76	0.67
ANALYTICSCORE2025.11		0.8	0.86	0.64	0.59	0.79	0.78	0.61	0.59	0.8	0.68	0.72	0.78	0.68	0.6
ANALYTICSCORE2025.11		0.8	0.82	0.68	0.59	0.81	0.76	0.62	0.59	0.78	0.64	0.71	0.77	0.68	0.6
BERT2025.11		0.8	0.8	0.7	0.7	0.8	0.81	0.69	0.68	0.84	0.71	0.75	0.79	0.74	0.69
GPT-4.12025.11		0.69	0.65	0.61	0.65	0.72	0.61	0.34	0.57	0.76	0.69	0.63	0.67	0.68	0.45
AutoSAS2025.11		0.68	0.47	0.57	0.61	0.5	0.54	0.37	0.44	0.77	0.68	0.56	0.57	0.65	0.41
NAM2025.11		0.63	0.62	0.43	0.35	0.72	0.63	0.42	0.38	0.76	0.62	0.56	0.64	0.52	0.4
AsRRN2025.11		0.6	0.43	0.57	0.6	0.61	0.64	0.59	0.51	0.71	0.66	0.59	0.59	0.63	0.55
ANALYTICSCORE2025.11		0.57	0.57	0.59	0.56	0.69	0.47	0.52	0.45	0.74	0.6	0.58	0.58	0.63	0.48