Medical history-taking on Avey
32.9PrecisionDeepSeek-R1-7B (IGFT)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DeepSeek-R1-7B (IGFT)Fine-tuning=IGFT, Base Model=DeepSeek-R1-Distill-Qwen-7B2026.01 | 32.9 | 61.1 | 40.8 | |
| DeepSeek-R1-Distill-Qwen-7BFine-tuning=None2026.01 | 29.7 | 58.4 | 36.8 | |
| Llama-3.1-8B (IGFT)Fine-tuning=IGFT, Base Model=Llama-3.1-8B-Instruct2026.01 | 28.6 | 67.1 | 38.4 | |
| HuatuoGPT-o1-7BDomain-specific=true2026.01 | 28.2 | 64.3 | 37.7 | |
| Llama-3.1-8B-InstructFine-tuning=None2026.01 | 27.1 | 64.8 | 36.7 | |
| GPT-4o-mini2026.01 | 26.8 | 68.7 | 37.2 | |
| UltraMedical-8BDomain-specific=true2026.01 | 25 | 66.1 | 34.9 |