Natural Language Understanding on GLUE base (test) benchmark leaderboard · SOTA2 Research

Natural Language Understanding on GLUE base (test)

61.21CoLA (MCC)Auto-FlexSwitch+CKA

Evaluation Results

Method	Links
Auto-FlexSwitch+CKA2026.04		61.21	92.78	88.73	91	86.79	92.15	75.45	84.02
Individual2026.04		60.18	94.04	89.22	91.41	87.17	92.71	79.06	84.83
Auto-FlexSwitch+MSE2026.04		58.3	92.78	88.24	90.92	86.44	92.04	74.45	83.31
Auto-FlexSwitch+KL2026.04		58.06	93.8	88.56	91.05	86.74	91.85	75.81	83.7
Traditional MTL2026.04		57.06	94.04	88.48	88.19	84.35	91.36	79.06	83.22
Twin-merging2026.04		56.51	93.92	88.48	88.2	85.81	92.4	74.37	82.81
Auto-Switch2026.04		53.39	94.26	89.21	91.29	85.47	92.49	75.09	83.03
DF-Merge2026.04		43.23	59.29	76.47	80.19	66.15	66.58	57.04	64.14
EMR-merging2026.04		39.34	93.58	87.01	89.87	85.78	89.53	74.73	79.98
Ties-Merging2026.04		36.73	87.27	78.92	82.96	63.68	80.69	72.2	71.78
RegMean2026.04		33.88	90.71	76.47	83.81	70.34	82.39	58.12	70.82
AdaMerging++2026.04		29.81	89.33	78.43	82.46	64.65	79.66	72.92	71.04
DARE2026.04		29.46	84.98	79.41	82.54	57.89	75.69	67.85	68.26
Task-Arithmetic2026.04		29.09	84.63	78.43	82.61	57.41	75.84	64.62	67.52
Weight-Averaging2026.04		18.08	81.88	77.94	79.6	44.92	71.06	61.73	62.17
AdaMerging2026.04		17.11	87.84	79.17	83.65	69.28	72.38	63.18	67.52
Fisher Merging2026.04		13.16	83.83	77.45	80.26	48.75	73.66	62.45	62.79
Pre-trained2026.04		0	49.08	31.62	36.82	31.82	50.89	47.29	35.36