Gene regulation direction prediction on LINCSQA L1000
0.52Accuracy (Bone marrow)PBIO-AGENT-8B
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| PBIO-AGENT-8BModel Category=Ours2026.02 | 0.52 | 0.69 | 0.64 | 0.58 | 0.68 | 0.55 | 0.56 | 0.81 | |
| DeepSeek-R1-Distill-Llama-8BModel Category=Generalist LLM2026.02 | 0.49 | 0.49 | 0.51 | 0.46 | 0.5 | 0.54 | 0.52 | 0.5 | |
| BioMedGPT-LM-7BModel Category=Specialist LLM2026.02 | 0.49 | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | |
| Qwen3-30B-A3BModel Category=Generalist LLM2026.02 | 0.47 | 0.62 | 0.53 | 0.43 | 0.58 | 0.52 | 0.66 | 0.6 | |
| BioMistral-7BModel Category=Specialist LLM2026.02 | 0.47 | 0.51 | 0.49 | 0.51 | 0.49 | 0.49 | 0.5 | 0.51 | |
| TxGemma-27BModel Category=Specialist LLM2026.02 | 0.47 | 0.5 | 0.48 | 0.45 | 0.54 | 0.46 | 0.56 | 0.53 | |
| Llama3-8BModel Category=Generalist LLM2026.02 | 0.46 | 0.53 | 0.49 | 0.53 | 0.58 | 0.54 | 0.5 | 0.53 | |
| Biomni-R0-32BModel Category=Specialist LLM2026.02 | 0.42 | 0.55 | 0.53 | 0.48 | 0.55 | 0.55 | 0.58 | 0.56 | |
| Mistral-Small-3.2-24BModel Category=Generalist LLM2026.02 | 0.41 | 0.52 | 0.5 | 0.47 | 0.55 | 0.51 | 0.52 | 0.53 |