Title and Abstract Screening on spHRI title and abstract screening corrected ground truth
0.0116TPGemma
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| GemmaModel Version=Gemma32026.06 | 0.0116 | 0.0807 | 0.9075 | 0.0002 | 9.23 | 98.15 | 91.84 | 1.27 | 8.16 | 2.5 | |
| Human ReviewerMode=Original single-pass screening2026.06 | 0.0094 | 0.9893 | 0.0012 | 0 | 99.88 | 100 | 0.12 | 88.53 | 99.88 | 93.92 | |
| QwenModel Version=Qwen32026.06 | 0.0086 | 0.8758 | 0.1123 | 0.0033 | 88.44 | 72.56 | 11.37 | 7.12 | 88.63 | 12.97 | |
| LlamaModel Version=Llama3.22026.06 | 0.0085 | 0.9266 | 0.0615 | 0.0034 | 93.51 | 71.77 | 6.23 | 12.16 | 93.77 | 20.8 | |
| DeepSeekModel Version=DeepSeek-R12026.06 | 0.0082 | 0.7667 | 0.2215 | 0.0037 | 77.49 | 69.13 | 22.41 | 3.57 | 77.59 | 6.79 | |
| Combined SLMDescription=Ensemble of SLMs2026.06 | 0.0057 | 0.9734 | 0.0148 | 0.0061 | 97.91 | 48.28 | 1.49 | 27.98 | 98.51 | 35.43 |