Bioinformatics Response Generation on PRSGPT 1.0 (test)
0.41Exact Match RatioQwen2.5-7B
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5-7Bstatus=fine-tuned, backbone=Qwen2.5-7B, alias=Q7B2025.12 | 0.41 | 0.93 | 0.91 | 0.95 | 0.94 | 0.92 | 0.93 | 0.91 | 0.87 | 0.93 | 1 | 0.98 | 0.96 | 0.34 | |
| BUTstatus=unfine-tuned, description=best-performing unfine-tuned model2025.12 | 0 | 0.22 | 0.19 | 0.39 | 0.24 | 0.08 | 0.23 | 0.23 | 0.05 | 0.26 | 0.94 | 0.73 | 0.56 | 0.51 | |
| LLaMA-3.2-3Bstatus=fine-tuned, backbone=LLaMA-3.2-3B, alias=L3B2025.12 | 0 | 0.3 | 0.28 | 0.44 | 0.42 | 0.17 | 0.27 | 0.37 | 0.13 | 0.35 | 0.94 | 0.79 | 0.62 | 0.23 | |
| Gemmastatus=fine-tuned, backbone=Gemma, alias=GM2025.12 | 0 | 0.16 | 0.24 | 0.37 | 0.24 | 0.09 | 0.14 | 0.22 | 0.08 | 0.32 | 0.95 | 0.78 | 0.6 | 0 |