Error Detection on MuSiQue benchmark leaderboard · SOTA2 Research

Error Detection on MuSiQue

0.93F1 ScoreEnsemble-A

Evaluation Results

Method	Links
Ensemble-A2026.02		0.93	0.91	0.95	0.62
Ensemble-A2026.02		0.93	—	—	0.62
DBA-A2026.02		0.91	0.92	0.91	0.65
Ensemble-I2026.02		0.91	0.91	0.9	0.6
DBA-A2026.02		0.91	—	—	0.65
Ensemble-I2026.02		0.91	—	—	0.6
DBA-I2026.02		0.89	0.92	0.87	0.65
DBA-I2026.02		0.89	—	—	0.65
Ensemble-A2026.02		0.88	0.85	0.92	0.72
Ensemble-I2026.02		0.88	0.85	0.91	0.7
Ensemble-A2026.02		0.88	—	—	0.72
Ensemble-I2026.02		0.88	—	—	0.7
DBA-A2026.02		0.86	0.88	0.85	0.74
DBA-A2026.02		0.86	—	—	0.74
DBA-I2026.02		0.84	0.86	0.82	0.71
DBA-I2026.02		0.84	—	—	0.71
AYS2026.02		0.79	0.93	0.68	0.64
AYS2026.02		0.79	—	—	0.64
AYS2026.02		0.7	0.9	0.57	0.69
AYS2026.02		0.7	—	—	0.69
Ensemble-A2026.02		0.69	0.75	0.65	0.73
Ensemble-A2026.02		0.69	—	—	0.73
Ensemble-I2026.02		0.68	0.69	0.66	0.71
Ensemble-I2026.02		0.68	—	—	0.71
DBA-A2026.02		0.66	0.75	0.59	0.72
DBA-A2026.02		0.66	—	—	0.72
DBA-I2026.02		0.64	0.68	0.6	0.68
DBA-I2026.02		0.64	—	—	0.68
IC-IDK2026.02		0.54	0.95	0.38	0.61
IC-IDK2026.02		0.54	—	—	0.62
AYS2026.02		0.38	0.91	0.24	0.61
AYS2026.02		0.38	—	—	0.61
IC-IDK2026.02		0.27	0.91	0.16	0.57
IC-IDK2026.02		0.27	—	—	0.57
IC-IDK2026.02		0.22	0.96	0.12	0.55
IC-IDK2026.02		0.22	—	—	0.55