Perturbation prediction on PBMC benchmark leaderboard · SOTA2 Research

Perturbation prediction on PBMC

81DE OverlapSCALE

Evaluation Results

Method	Links
SCALE2026.03		81	—	83.1	—	68.2	0.516	—	—	0.979	0.032	0.118	—	—	—
PerturbDiff2026.02		56.4	0.997	58.1	0.288	75.1	0.519	60.7	60.3	0.816	0.0002	0.006	0.972	0.975	0.986
Mean2026.02		56.4	0.959	54.4	0.011	74	0.478	54.5	50.6	0.642	0.0008	0.013	0.73	0.777	0.787
PerturbDiff2026.03		56.4	—	58.1	—	75.1	0.519	—	—	0.816	0.0002	0.006	—	—	—
Mean2026.03		56.4	—	54.4	—	74	0.478	—	—	0.642	0.0008	0.013	—	—	—
Mean Variant2026.02		55.7	0.973	54.2	—	65.6	0.25	54.3	50	0.408	0.001	0.013	0.508	0.508	0.508
Mean Variant (Overall)2026.03		55.7	—	54.2	—	65.6	0.25	—	—	0.408	0.001	0.013	—	—	—
Mean Variant2026.02		55.4	0.999	54.2	0.019	72.7	0.489	54.3	50.1	0.517	0.0006	0.007	0.612	0.587	0.655
Mean Variant (per Batch)2026.03		55.4	—	54.2	—	72.7	0.489	—	—	0.517	0.0006	0.007	—	—	—
Linear2026.02		54.9	0.997	58.1	0.194	66.6	0.366	59.1	55.6	0.646	0.0004	0.009	0.658	0.67	0.903
Linear2026.03		54.9	—	58.1	—	66.6	0.366	—	—	0.646	0.0004	0.009	—	—	—
PerturbDiff2026.02		53.3	0.991	58.8	0.387	70.1	0.431	66.9	64.7	0.705	0.0003	0.008	0.941	0.959	0.972
STATE2026.02		51.2	0.998	54.7	-0.363	78.9	0.602	54.7	51.3	0.796	0.0001	0.005	0.954	0.943	0.985
STATE2026.03		51.2	—	54.7	—	78.9	0.602	—	—	0.796	0.0001	0.005	—	—	—
Mean Variant2026.02		50.6	0.992	54.2	-0.108	63.5	0.247	54.2	50	0.4	0.0006	0.009	0.625	0.596	0.612
Mean Variant (per Cell Type)2026.03		50.6	—	54.2	—	63.5	0.247	—	—	0.4	0.0006	0.009	—	—	—
CPA2026.02		48.8	0.919	51.5	-0.154	53.9	0.369	51.5	50	0.181	0.011	0.052	0.576	0.613	0.597
CPA2026.03		48.8	—	51.5	—	53.9	0.369	—	—	0.181	0.011	0.052	—	—	—
Squidiff2026.02		35.9	-218	54.7	—	37.9	0.022	54.7	50	0.033	4.387	2.062	0.508	0.508	0.508
Squidiff2026.03		35.9	—	54.7	—	37.9	0.022	—	—	0.033	4.387	2.062	—	—	—
CellFlow2026.02		27	0.994	35	0.042	65.2	0.377	35.4	50.2	0.628	0.0004	0.009	0.639	0.689	0.725
CellFlow2026.03		27	—	35	—	65.2	0.377	—	—	0.628	0.0004	0.009	—	—	—