Perturbation prediction on Tahoe100M
0.806DEOverSCALE
Evaluation Results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SCALEimplementation=reproduced, protocol=Few-shot2026.03 | 0.806 | — | 0.765 | — | 0.949 | 0.876 | — | — | 0.953 | 0.0002 | 0.006 | — | — | — | |
| STATEimplementation=reproduced, protocol=Few-shot2026.03 | 0.728 | — | 0.698 | — | 0.918 | 0.851 | — | — | 0.85 | 0.0006 | 0.036 | — | — | — | |
| PerturbDifftraining_protocol=Finetuned2026.02 | 0.58 | 0.893 | 0.598 | 0.478 | 0.641 | 0.691 | 61.8 | 65.8 | 0.648 | 0.001 | 0.017 | 0.784 | 0.883 | 0.903 | |
| PerturbDifftraining_protocol=Scratch2026.02 | 0.522 | 0.963 | 0.572 | 0.531 | 0.734 | 0.445 | 58.4 | 62.1 | 0.686 | 0.0006 | 0.012 | 0.97 | 0.978 | 0.975 | |
| PerturbDiffprotocol=Few-shot2026.03 | 0.522 | — | 0.572 | — | 0.734 | 0.445 | — | — | 0.686 | 0.0006 | 0.012 | — | — | — | |
| Linear2026.02 | 0.505 | 0.993 | 0.576 | 0.382 | 0.76 | 0.514 | 60.5 | 63.2 | 0.723 | 0.0004 | 0.009 | 0.887 | 0.881 | 0.912 | |
| Linearprotocol=Few-shot2026.03 | 0.505 | — | 0.576 | — | 0.76 | 0.514 | — | — | 0.723 | 0.0004 | 0.009 | — | — | — | |
| Mean Variantaggregation_level=per Cell Type2026.02 | 0.504 | 0.976 | 0.508 | 0.023 | 0.688 | 0.578 | 50.8 | 50.8 | 0.461 | 0.0007 | 0.01 | 0.682 | 0.694 | 0.76 | |
| Mean Variant (per Cell Type)protocol=Few-shot2026.03 | 0.504 | — | 0.508 | — | 0.688 | 0.578 | — | — | 0.461 | 0.0007 | 0.01 | — | — | — | |
| CPA2026.02 | 0.502 | 0.946 | 0.504 | 0.19 | 0.71 | 0.466 | 50.5 | 50 | 0.425 | 0.0009 | 0.011 | 0.654 | 0.593 | 0.585 | |
| CPAprotocol=Few-shot2026.03 | 0.502 | — | 0.504 | — | 0.71 | 0.466 | — | — | 0.425 | 0.0009 | 0.011 | — | — | — | |
| STATE2026.02 | 0.499 | 0.807 | 0.522 | 0.301 | 0.665 | 0.644 | 52 | 50.6 | 0.535 | 0.0021 | 0.021 | 0.789 | 0.846 | 0.854 | |
| Mean2026.02 | 0.43 | 0.703 | 0.504 | 0.35 | 0.595 | 0.28 | 50.6 | 50.2 | 0.205 | 0.0031 | 0.026 | 0.515 | 0.508 | 0.508 | |
| Meanprotocol=Few-shot2026.03 | 0.43 | — | 0.504 | — | 0.595 | 0.28 | — | — | 0.205 | 0.0031 | 0.026 | — | — | — | |
| Mean Variantaggregation_level=Overall2026.02 | 0.429 | 0.707 | 0.504 | 0.469 | 0.591 | 0.275 | 50.5 | 50 | 0.193 | 0.0031 | 0.026 | 0.501 | 0.501 | 0.501 | |
| Mean Variant (Overall)protocol=Few-shot2026.03 | 0.429 | — | 0.504 | — | 0.591 | 0.275 | — | — | 0.193 | 0.0031 | 0.026 | — | — | — | |
| Mean Variantaggregation_level=per Batch2026.02 | 0.427 | 0.705 | 0.504 | 0.475 | 0.587 | 0.27 | 50.5 | 50 | 0.185 | 0.0031 | 0.026 | 0.492 | 0.496 | 0.498 | |
| Mean Variant (per Batch)protocol=Few-shot2026.03 | 0.427 | — | 0.504 | — | 0.587 | 0.27 | — | — | 0.185 | 0.0031 | 0.026 | — | — | — | |
| Squidiff2026.02 | 0.42 | -616.98 | 0.581 | — | 0.501 | 0.276 | 58.1 | 50 | 0.011 | 5.627 | 2.244 | 0.505 | 0.506 | 0.505 | |
| Squidiffprotocol=Few-shot2026.03 | 0.42 | — | 0.581 | — | 0.501 | 0.276 | — | — | 0.011 | 5.627 | 2.244 | — | — | — | |
| CellFlow2026.02 | 0.183 | 0.682 | 0.313 | 0.346 | 0.638 | 0.298 | 32 | 50 | 0.269 | 0.0031 | 0.027 | 0.608 | 0.564 | 0.55 | |
| CellFlowprotocol=Few-shot2026.03 | 0.183 | — | 0.313 | — | 0.638 | 0.298 | — | — | 0.269 | 0.0031 | 0.027 | — | — | — |