Gene-disease validity curation (test)
79.5Outcome AccuracyQwen3-8B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen3-8BSetting=GRPO (Process + Outcome), Agent Configuration=Single-Agent2026.02 | 79.5 | 32.3 | 56.5 | — | — | |
| Qwen3-1.7BSetting=GRPO (Outcome Only), Agent Configuration=Multi-Agent2026.02 | 78.6 | 10.9 | 18.4 | 11.4 | 38.3 | |
| Qwen3-4BSetting=GRPO (Process + Outcome), Agent Configuration=Single-Agent2026.02 | 78.6 | 38.2 | 55.7 | — | — | |
| Qwen3-1.7BSetting=GRPO (Process + Outcome), Agent Configuration=Single-Agent2026.02 | 78.2 | 33.2 | 57.5 | — | — | |
| Qwen3-4BSetting=GRPO (Outcome Only), Agent Configuration=Single-Agent2026.02 | 78.2 | 9.5 | 28.6 | — | — | |
| Qwen3-1.7BSetting=GRPO (Outcome Only), Agent Configuration=Single-Agent2026.02 | 77.7 | 8.2 | 16.4 | — | — | |
| Qwen3-8BSetting=GRPO (Outcome Only), Agent Configuration=Single-Agent2026.02 | 76.4 | 11.8 | 30 | — | — | |
| Qwen3-1.7BSetting=GRPO (Process + Outcome), Agent Configuration=Multi-Agent2026.02 | 75 | 29.1 | 50.1 | 39.5 | 48.5 | |
| Qwen3-4BSetting=GRPO (Outcome Only), Agent Configuration=Multi-Agent2026.02 | 73.2 | 4.5 | 39.2 | 8.2 | 47.9 | |
| Qwen3-4BSetting=GRPO (Process + Outcome), Agent Configuration=Multi-Agent2026.02 | 73.2 | 29.1 | 52 | 45.5 | 58.8 | |
| Qwen3-8BSetting=GRPO (Process + Outcome), Agent Configuration=Multi-Agent2026.02 | 71.8 | 32.7 | 54.2 | 45.9 | 61.1 | |
| Qwen3-8BSetting=GRPO (Outcome Only), Agent Configuration=Multi-Agent2026.02 | 70.5 | 7.7 | 39.6 | 12.7 | 42.6 | |
| Qwen3-1.7BSetting=Base Model, Agent Configuration=Multi-Agent2026.02 | 31.4 | 1.4 | 35.3 | 18.6 | 46.7 | |
| Qwen3-8BSetting=Base Model, Agent Configuration=Multi-Agent2026.02 | 21.8 | 9.5 | 46.9 | 13.2 | 43.6 | |
| Qwen3-1.7BSetting=Base Model, Agent Configuration=Single-Agent2026.02 | 21.4 | 0 | 17.1 | — | — | |
| DeepSeek-V3.2Setting=Base Model, Agent Configuration=Single-Agent2026.02 | 20.9 | 8.6 | 45.1 | — | — | |
| DeepSeek-V3.2Setting=Base Model, Agent Configuration=Multi-Agent2026.02 | 20.9 | 11.4 | 45.5 | 17.7 | 46.4 | |
| GPT-5-miniSetting=Base Model, Agent Configuration=Single-Agent2026.02 | 20.9 | 2.7 | 20.7 | — | — | |
| Qwen3-4BSetting=Base Model, Agent Configuration=Multi-Agent2026.02 | 19.5 | 6.8 | 41.7 | 10.5 | 50.4 | |
| GPT-5-miniSetting=Base Model, Agent Configuration=Multi-Agent2026.02 | 19.1 | 9.5 | 33.1 | 11.4 | 48.5 | |
| Qwen3-8BSetting=Base Model, Agent Configuration=Single-Agent2026.02 | 7.7 | 0.5 | 32.4 | — | — | |
| Qwen3-4BSetting=Base Model, Agent Configuration=Single-Agent2026.02 | 4.5 | 3.2 | 36.7 | — | — |