Clinical guideline extraction on NICE guidelines (full)
440.75LengthLINES
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| LINESModel Family=GPT-5-mini2026.06 | 440.75 | 21.11 | 14.72 | 94.33 | 22.79 | 21.07 | 94.35 | 31.1 | |
| LINESModel Family=Qwen3-235B2026.06 | 225.03 | 34.42 | 29.19 | 85.24 | 38.5 | 34.35 | 85.15 | 44.12 | |
| LINESModel Family=DeepSeek-V32026.06 | 222.76 | 34.46 | 27.76 | 88.83 | 37.35 | 36.41 | 90.73 | 47 | |
| JuniorDocModel Family=GPT-5-mini2026.06 | 193.01 | 31.99 | 23.17 | 91.55 | 33.4 | 27.95 | 97.18 | 44.11 | |
| JuniorDocModel Family=DeepSeek-V32026.06 | 147.19 | 34.43 | 24.7 | 89.63 | 36.09 | 33.99 | 95.97 | 47.03 | |
| JuniorDocModel Family=Qwen3-235B2026.06 | 96.14 | 48.4 | 41.87 | 90.8 | 52.28 | 49.97 | 94.57 | 61.15 | |
| SafetyModel Family=GPT-5-mini2026.06 | 91.16 | 46.51 | 36.82 | 87.74 | 48.48 | 46.68 | 96.15 | 59.32 | |
| SafetyModel Family=DeepSeek-V32026.06 | 77.73 | 49.79 | 42.07 | 85.78 | 52.34 | 48.56 | 91.28 | 59.9 | |
| COPYModel Family=GPT-5-mini2026.06 | 68.66 | 59.64 | 58.56 | 89.11 | 65.58 | 62.8 | 91.84 | 70.27 | |
| SafetyModel Family=Qwen3-235B2026.06 | 65.88 | 49.76 | 45.93 | 80.29 | 54.38 | 50.21 | 82.73 | 59.37 | |
| COPYModel Family=DeepSeek-V32026.06 | 65.5 | 63.6 | 64.11 | 86.34 | 69.44 | 68.44 | 90.44 | 74.19 | |
| COPYModel Family=Qwen3-235B2026.06 | 46.34 | 62.96 | 65.04 | 82.5 | 69.38 | 68.32 | 84.67 | 72.85 |