Question Answering on ATE-Bench Q&A suite (Q1–Q12) benchmark leaderboard · SOTA2 Research

Question Answering on ATE-Bench Q&A suite (Q1–Q12)

54Agent TurnsMegatron-LM

Evaluation Results

Method	Links
Megatron-LM2026.05		54	41,200	10,700
Megatron-LM2026.05		48	46,500	10,700
Megatron-LM2026.05		36	41,300	10,000
Megatron-LM2026.05		34	45,200	7,600
Megatron-LM2026.05		33	45,800	9,000
TorchTitan2026.05		28	43,500	7,800
TorchTitan2026.05		26	39,700	6,900
PithTrain2026.05		21	33,800	4,600
Megatron-LM2026.05		20	30,800	4,700
TorchTitan2026.05		19	41,700	4,800
Megatron-LM2026.05		19	37,800	5,900
TorchTitan2026.05		18	44,300	7,100
PithTrain2026.05		18	35,900	5,400
Megatron-LM2026.05		18	37,100	5,100
TorchTitan2026.05		17	38,800	5,100
PithTrain2026.05		16	31,100	5,200
TorchTitan2026.05		16	38,600	6,000
PithTrain2026.05		16	37,000	5,100
PithTrain2026.05		15	33,400	4,100
Megatron-LM2026.05		14	31,300	3,400
TorchTitan2026.05		14	36,100	3,500
PithTrain2026.05		14	31,500	4,200
PithTrain2026.05		13	34,100	3,400
Megatron-LM2026.05		12	36,400	4,500
TorchTitan2026.05		12	30,000	3,400
PithTrain2026.05		11	27,900	3,300
TorchTitan2026.05		11	32,700	3,500
PithTrain2026.05		11	29,400	2,900
Megatron-LM2026.05		10	31,300	3,100
PithTrain2026.05		10	31,100	2,600
Megatron-LM2026.05		9	31,500	2,600
PithTrain2026.05		9	28,700	3,200
TorchTitan2026.05		8	30,100	2,500
PithTrain2026.05		6	25,600	2,000
TorchTitan2026.05		5	33,900	2,200
TorchTitan2026.05		4	29,900	2,300