Perturbation prediction on PBMC
81DE OverlapSCALE
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SCALEimplementation=reproduced, protocol=Few-shot2026.03 | 81 | — | 83.1 | — | 68.2 | 0.516 | — | — | 0.979 | 0.032 | 0.118 | — | — | — | |
| PerturbDifftraining_protocol=Scratch2026.02 | 56.4 | 0.997 | 58.1 | 0.288 | 75.1 | 0.519 | 60.7 | 60.3 | 0.816 | 0.0002 | 0.006 | 0.972 | 0.975 | 0.986 | |
| Mean2026.02 | 56.4 | 0.959 | 54.4 | 0.011 | 74 | 0.478 | 54.5 | 50.6 | 0.642 | 0.0008 | 0.013 | 0.73 | 0.777 | 0.787 | |
| PerturbDiffprotocol=Few-shot2026.03 | 56.4 | — | 58.1 | — | 75.1 | 0.519 | — | — | 0.816 | 0.0002 | 0.006 | — | — | — | |
| Meanprotocol=Few-shot2026.03 | 56.4 | — | 54.4 | — | 74 | 0.478 | — | — | 0.642 | 0.0008 | 0.013 | — | — | — | |
| Mean Variantaggregation_level=Overall2026.02 | 55.7 | 0.973 | 54.2 | — | 65.6 | 0.25 | 54.3 | 50 | 0.408 | 0.001 | 0.013 | 0.508 | 0.508 | 0.508 | |
| Mean Variant (Overall)protocol=Few-shot2026.03 | 55.7 | — | 54.2 | — | 65.6 | 0.25 | — | — | 0.408 | 0.001 | 0.013 | — | — | — | |
| Mean Variantaggregation_level=per Batch2026.02 | 55.4 | 0.999 | 54.2 | 0.019 | 72.7 | 0.489 | 54.3 | 50.1 | 0.517 | 0.0006 | 0.007 | 0.612 | 0.587 | 0.655 | |
| Mean Variant (per Batch)protocol=Few-shot2026.03 | 55.4 | — | 54.2 | — | 72.7 | 0.489 | — | — | 0.517 | 0.0006 | 0.007 | — | — | — | |
| Linear2026.02 | 54.9 | 0.997 | 58.1 | 0.194 | 66.6 | 0.366 | 59.1 | 55.6 | 0.646 | 0.0004 | 0.009 | 0.658 | 0.67 | 0.903 | |
| Linearprotocol=Few-shot2026.03 | 54.9 | — | 58.1 | — | 66.6 | 0.366 | — | — | 0.646 | 0.0004 | 0.009 | — | — | — | |
| PerturbDifftraining_protocol=Finetuned2026.02 | 53.3 | 0.991 | 58.8 | 0.387 | 70.1 | 0.431 | 66.9 | 64.7 | 0.705 | 0.0003 | 0.008 | 0.941 | 0.959 | 0.972 | |
| STATE2026.02 | 51.2 | 0.998 | 54.7 | -0.363 | 78.9 | 0.602 | 54.7 | 51.3 | 0.796 | 0.0001 | 0.005 | 0.954 | 0.943 | 0.985 | |
| STATEprotocol=Few-shot2026.03 | 51.2 | — | 54.7 | — | 78.9 | 0.602 | — | — | 0.796 | 0.0001 | 0.005 | — | — | — | |
| Mean Variantaggregation_level=per Cell Type2026.02 | 50.6 | 0.992 | 54.2 | -0.108 | 63.5 | 0.247 | 54.2 | 50 | 0.4 | 0.0006 | 0.009 | 0.625 | 0.596 | 0.612 | |
| Mean Variant (per Cell Type)protocol=Few-shot2026.03 | 50.6 | — | 54.2 | — | 63.5 | 0.247 | — | — | 0.4 | 0.0006 | 0.009 | — | — | — | |
| CPA2026.02 | 48.8 | 0.919 | 51.5 | -0.154 | 53.9 | 0.369 | 51.5 | 50 | 0.181 | 0.011 | 0.052 | 0.576 | 0.613 | 0.597 | |
| CPAprotocol=Few-shot2026.03 | 48.8 | — | 51.5 | — | 53.9 | 0.369 | — | — | 0.181 | 0.011 | 0.052 | — | — | — | |
| Squidiff2026.02 | 35.9 | -218 | 54.7 | — | 37.9 | 0.022 | 54.7 | 50 | 0.033 | 4.387 | 2.062 | 0.508 | 0.508 | 0.508 | |
| Squidiffprotocol=Few-shot2026.03 | 35.9 | — | 54.7 | — | 37.9 | 0.022 | — | — | 0.033 | 4.387 | 2.062 | — | — | — | |
| CellFlow2026.02 | 27 | 0.994 | 35 | 0.042 | 65.2 | 0.377 | 35.4 | 50.2 | 0.628 | 0.0004 | 0.009 | 0.639 | 0.689 | 0.725 | |
| CellFlowprotocol=Few-shot2026.03 | 27 | — | 35 | — | 65.2 | 0.377 | — | — | 0.628 | 0.0004 | 0.009 | — | — | — |