Masked Language Modeling on C4 (val) benchmark leaderboard · SOTA2 Research

Masked Language Modeling on C4 (val)

3.828PPLXFLASH-Quad

Evaluation Results

Method	Links
FLASH-Quad2022.02		3.828	84.9
FLASH-Quad2022.02		3.83	132.1
FLASH-Quad2022.02		3.864	61.7
Transformer++2022.02		3.876	143.4
FLASH2022.02		3.897	59.9
FLASH2022.02		3.902	50.7
Transformer++2022.02		3.92	91.6
FLASH2022.02		3.928	51.4
Transformer++2022.02		3.933	252.1
FLASH-Quad2022.02		3.964	50.1
Transformer+2022.02		3.986	252.9
Transformer+2022.02		3.989	142.9
FLASH2022.02		4.015	50.1
Transformer+2022.02		4.032	91.5
Transformer++2022.02		4.058	64.6
Transformer+2022.02		4.151	64.4
FLASH2022.02		4.172	51.2
FLASH-Quad2022.02		4.176	43.7
Combiner2022.02		4.195	68.3
Transformer2022.02		4.196	90.9
Transformer++2022.02		4.205	47.6
Combiner2022.02		4.225	77.3
Combiner2022.02		4.238	66.4
Transformer+2022.02		4.283	48.8
Combiner2022.02		4.317	66.4
Transformer2022.02		4.436	63.9
Combiner2022.02		4.449	67.2
Transformer2022.02		4.517	47.7
Transformer2022.02		4.602	142.5
Transformer2022.02		4.8766	252.7
Performer2022.02		5.897	37.2
Performer2022.02		6.324	37.6
Performer2022.02		8.032	39.1
Performer2022.02		12.622	36.9
Performer2022.02		102.98	40.9