Question Answering on ECQA benchmark leaderboard · SOTA2 Research

Question Answering on ECQA

70.34AccuracyLLaMA3.1-8B

Evaluation Results

Method	Links
LLaMA3.1-8B2025.06		70.34	7.58	8.05	8.53	5	18.22	31.3
LLaMA3.1-8B2025.06		70.34	7.64	8.1	8.57	7.2	20.22	32.86
LLaMA3.1-8B2025.06		69.7	9.16	9.72	10.28	7.86	20.58	33.45
LLaMA3.1-8B2025.06		67.68	1.36	1.67	1.96	36.59	43.66	51.24
LLaMA3.2-3B2025.06		67.13	1.11	1.46	1.81	10.04	22.52	35.02
LLaMA3.2-3B2025.06		67.13	1.3	1.63	1.96	10.5	22.65	34.81
LLaMA3.1-8B2025.06		67.03	0.87	1.22	1.55	34.71	42.52	49.87
LLaMA3.1-8B2025.06		67.03	1.35	1.67	1.96	34.71	42.65	50.15
LLaMA3.2-3B2025.06		66.12	2.14	2.47	2.8	12.94	24.71	36.5
LLaMA3.2-3B2025.06		62.99	2.54	2.82	2.99	33.3	41.9	50.17
LLaMA3.2-3B2025.06		62.44	1.9	2.32	2.72	28.61	36.72	44.53
LLaMA3.2-3B2025.06		62.44	1.97	2.37	2.73	29.04	37.17	45.05