Gene regulation direction prediction on PerturbQA (HepG2)
0.72AUROCSYNTHPERT
Evaluation Results
| Method | Links | |
|---|---|---|
| SYNTHPERT2025.09 | 0.72 | |
| PBIO-AGENTModel size=8B2026.02 | 0.67 | |
| SUMMER2026.02 | 0.65 | |
| SUMMER2025.09 | 0.65 | |
| GAT2026.02 | 0.64 | |
| GAT2025.09 | 0.64 | |
| GenePTvariant=GENE2026.02 | 0.58 | |
| GENEPT-GENE2025.09 | 0.58 | |
| GenePTvariant=PROT2026.02 | 0.55 | |
| GENEPT-PROT2025.09 | 0.55 | |
| LLM + SFT ON DATA2025.09 | 0.55 | |
| GEARS2026.02 | 0.52 | |
| GEARS2025.09 | 0.52 | |
| SCGPT2026.02 | 0.51 | |
| LLMRetrieval=false2026.02 | 0.51 | |
| SCGPT2025.09 | 0.51 | |
| RetrievalLLM=false2026.02 | 0.5 | |
| LLMCoT=false2026.02 | 0.49 |