Evidence Extraction on UCLH dataset (test)
77.17R-L Scorecopy
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| copyModel=Qwen2.5-32B-Instruct, AnsLen=39.752026.06 | 77.17 | 81.99 | 80.54 | 77.62 | 82.3 | 82.75 | 78.71 | |
| copyModel=GPT-OSS-120B, AnsLen=44.962026.06 | 75.37 | 78.84 | 82.76 | 76.67 | 79.79 | 84.85 | 78.07 | |
| safetyModel=GPT-OSS-120B, AnsLen=45.052026.06 | 70.82 | 73.71 | 80.14 | 71.69 | 74.24 | 81.74 | 72.95 | |
| linesModel=Qwen2.5-32B-Instruct, AnsLen=93.912026.06 | 68 | 63.49 | 90.4 | 68.2 | 65.84 | 91.28 | 70.36 | |
| safetyModel=Qwen2.5-32B-Instruct, AnsLen=39.442026.06 | 67.94 | 71.63 | 75.5 | 68.91 | 73.41 | 76.76 | 70.98 | |
| linesModel=GPT-OSS-120B, AnsLen=109.492026.06 | 62.31 | 53.8 | 94.06 | 62.53 | 56.31 | 94.85 | 65.4 | |
| juniorModel=GPT-OSS-120B, AnsLen=118.002026.06 | 49.83 | 42.05 | 87.45 | 50.85 | 44.14 | 87.53 | 52.98 | |
| juniorModel=Qwen2.5-32B-Instruct, AnsLen=146.332026.06 | 49.42 | 44.15 | 83.17 | 50.52 | 46.92 | 83.54 | 53.35 |