Continual Pre-training on Natural Instructions (val) benchmark leaderboard · SOTA2 Research

Continual Pre-training on Natural Instructions (val)

2.391Answer VerificationAnticurriculum

Evaluation Results

Method	Links
Anticurriculum2023.07		2.391	1.099	2.932	2.363	1.533	2.352	2.942	1.488	2.961	2.398	2.695	2.06	2.583	3.209	2.231	3.041	2.553	2.316	2.325	1.215	3.058	2.156	2.519	2.366
Curriculum2023.07		2.368	0.203	3.084	2.012	1.014	2.247	3.798	0.887	3.12	2.367	2.777	2.199	2.598	3.415	1.775	3.149	2.692	2.232	2.193	0.495	3.496	2.334	2.606	2.307
Skill-anticurriculum2023.07		2.325	1.232	2.925	2.068	0.959	2.338	2.099	1.044	3.36	2.707	2.876	2.1	2.408	3.308	1.823	3.021	2.635	2.304	2.156	1.455	3.155	2.424	2.574	2.317
Random2023.07		2.297	0.246	2.927	2.033	1.02	2.154	3.024	0.979	2.95	2.277	2.617	1.965	2.501	3.203	1.81	2.961	2.488	2.177	2.155	0.56	3.106	2.092	2.438	2.173
Skill-curriculum2023.07		2.249	0.126	2.891	1.853	0.825	2.286	3.889	0.941	3.019	2.689	3.062	2.385	2.311	3.607	1.361	3.323	3.001	2.324	2.037	0.433	3.758	1.784	2.849	2.304
Skill-stratified2023.07		2.18	0.178	2.805	1.803	0.859	2.14	2.68	0.845	3.264	2.542	2.783	1.958	2.225	3.278	1.385	2.96	2.57	2.152	1.926	0.49	3.199	1.916	2.506	2.115
SKILL-IT2023.07		2.158	0.223	2.784	1.863	0.908	2.073	2.797	0.876	3.216	2.448	2.666	1.895	2.236	3.213	1.556	2.907	2.448	2.093	1.952	0.553	3.129	1.952	2.432	2.103