Downstream Task Evaluation on DS-Avg 9 Downstream Tasks Suite benchmark leaderboard · SOTA2 Research

Downstream Task Evaluation on DS-Avg 9 Downstream Tasks Suite

63.6ARC-c AccuracyUncompressed

Evaluation Results

Method	Links
Uncompressed2026.05		63.6	80.5	86.3	85.9	88.1	83.4	51.8	74.6	88.3	78
REAP2026.05		63.3	81.6	71.8	84.8	84.7	83.3	53.2	77.1	81.7	75.7
STUN+Wanda2026.05		62.5	84.6	88.8	78.8	83.1	79.8	52.6	74.6	74.8	75.5
HodgeCover+Wanda2026.05		62.2	79.9	84.2	85.6	85.5	83.4	51.2	77.5	90.3	77.8
Uncompressed2026.05		62.1	79.5	87.9	82.5	84.9	83	53.5	74.7	86.9	77.2
REAM2026.05		61.9	81.7	74.6	83.5	83.5	83.1	52.9	75.6	82.6	75.5
HodgeCover2026.05		61.7	80.1	74.4	84.9	83.9	83.1	51.6	77.3	84.5	75.7
HodgeCover+Wanda2026.05		61.2	82.3	79.3	80.1	83.2	81.9	51.1	76.4	87.9	75.9
STUN+Wanda2026.05		59.6	84.8	82.1	71	78.3	76.9	49.6	73	62.3	70.8
REAP2026.05		57.1	76	90	81.5	79.8	82	53.2	75.1	87.6	75.8
HodgeCover+Wanda2026.05		56.5	78.5	90.8	76.8	78	80.8	50.3	74.1	85.5	74.6
HodgeCover2026.05		56.3	73.9	91.3	82.5	80.7	82.9	54.7	76.3	85.1	75.9
HodgeCover+Wanda2026.05		55.9	76	89	81.8	82.6	82.3	53.7	74.2	89.6	76.1
REAM2026.05		54.4	73.1	90.5	80.6	78.8	81.2	53.8	74	86.8	74.8
HodgeCover2026.05		52.2	71.1	75.3	77	69	80.1	51.5	76.4	78.1	70.1
STUN+Wanda2026.05		50.9	74.4	89.2	72.1	76.7	76.1	51	70.6	33.2	66
REAP2026.05		50.2	71.3	77.9	75.1	70	79.8	50.5	75	80.2	70
STUN+Wanda2026.05		49.6	76.6	89.5	63.8	69.2	72.9	47.1	67.5	22.1	62
MC-SMoE2026.05		49.2	72.4	80.5	81.8	71.6	82.1	54	75.6	82.4	72.2
Uncompressed2026.05		48.9	76.2	75	77	52.8	80.7	35.6	68.7	9.8	58.3
REAM2026.05		46.8	67.6	83.7	70.5	65.4	75.5	48.8	73.6	30.4	62.5
HodgeCover2026.05		46.4	67.5	88.1	72.5	54.5	78.1	51.7	73.7	67.5	66.7
REAP2026.05		46	69.8	88.2	71.4	58.7	77.3	48.2	72.5	65.3	66.4
MC-SMoE2026.05		45.1	64.6	89.2	78.3	62.5	81	51.3	76.1	83.9	70.2
REAM2026.05		42.7	64.4	87.2	67.9	51.7	74.1	46.9	70.9	39	60.5
STUN+Wanda2026.05		41.5	67.2	66.4	69.2	34.6	77.3	33.3	64.8	2.6	50.8
HodgeCover+Wanda2026.05		40.9	67.3	73	73.6	38.7	78.1	35.1	67.8	2.4	53
HodgeCover+Wanda2026.05		33.7	56.6	72.6	64.4	35	72.6	35.2	64.5	2.5	48.6
MC-SMoE2026.05		33.6	50.5	86	62.9	34.6	72.4	44	72.5	34	54.5
STUN+Wanda2026.05		32.9	58	62.5	55.3	26.9	71.7	36	61.1	1.8	45.1
HodgeCover2026.05		32.8	50.3	62.8	67	25.6	73	41.7	64.9	2.2	46.7
MC-SMoE2026.05		29	47.5	85.1	54.9	32.7	69.4	47.2	67.6	34.6	52
REAP2026.05		28.7	42.5	65.3	63.8	27.4	66.8	35.5	64.8	1.7	44.1
REAM2026.05		27.1	39.3	63.3	53	27.5	63.4	41.5	60.9	1.3	41.9
MC-SMoE2026.05		26.3	41.8	62.3	43.3	27.2	65.1	39.2	50.3	1.2	39.6
REAP2026.05		24.5	30.9	48	32.3	25.1	54.2	50.7	53.2	0	35.4
REAM2026.05		24.3	30.4	42.8	28.8	25.3	53.2	50.2	50.9	0	34
HodgeCover2026.05		24.2	29.5	38.6	30	25.4	52.7	47.7	51.2	0.1	33.3
MC-SMoE2026.05		23.6	30.8	43.3	27.9	23.5	54.1	50	50.8	0	33.8