Evidence classification (Task A) on TREC BioGen 2025
67.18Supporting PrecisionLLM_NLI_BM25
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LLM_NLI_BM25Team=CLaC2026.03 | 67.18 | 74.36 | 67.74 | 3.61 | 7.73 | 4.57 | — | — | — | — | — | — | — | — | |
| run6_ATeam=InfoLab2026.03 | 66.92 | 71.17 | 67.23 | 12.71 | 17.65 | 14.15 | — | — | — | — | — | — | — | — | |
| LLM_BM25Team=CLaC2026.03 | 66.75 | 67.46 | 64.1 | 3.95 | 7.6 | 4.77 | — | — | — | — | — | — | — | — | |
| task_aTeam=GEHC-HTIC2026.03 | 56.7 | 57.37 | 53.53 | 6.62 | 14 | 8.57 | — | — | — | — | — | — | — | — | |
| run4Team=InfoLab2026.03 | 52.92 | 60.3 | 54.49 | 10.74 | 15.12 | 11.85 | — | — | — | — | — | — | — | — | |
| run2Team=InfoLab2026.03 | 52.75 | 56.8 | 53.41 | 14.09 | 19.42 | 15.67 | — | — | — | — | — | — | — | — | |
| scifive-ftTeam=polito2026.03 | 52.58 | 64.54 | 55.81 | 4.04 | 6.7 | 4.79 | — | — | — | — | — | — | — | — | |
| task-a-1Team=SIB2026.03 | 52.41 | 74.23 | 58.87 | 0 | 0 | 0 | — | — | — | — | — | — | — | — | |
| TESTTeam=Baseline2026.03 | 51.03 | 44.07 | 44.34 | 3.44 | 8.08 | 4.67 | — | — | — | — | — | — | — | — | |
| emotionalTeam=dal2026.03 | 50.6 | 67.23 | 55.53 | 1.29 | 1.29 | 1.2 | — | — | — | — | — | — | — | — | |
| expert_promptRun=expert_prompt2026.03 | — | — | — | — | — | — | 13.33 | 13.33 | 3.33 | 3.33 | 30 | 30 | 3.33 | 3.33 | |
| gehc_hticRun=gehc_htic2026.03 | — | — | — | — | — | — | 38.33 | 41.67 | 5 | 6.67 | 68.33 | 71.67 | 5 | 6.67 | |
| LLM_BM25Run=LLM_BM252026.03 | — | — | — | — | — | — | 41.67 | 43.33 | 0 | 0 | 68.33 | 70 | 0 | 0 | |
| run1_sparseRun=run1_sparse2026.03 | — | — | — | — | — | — | 15 | 16.67 | 3.33 | 3.33 | 40 | 43.33 | 3.33 | 3.33 | |
| scifive-ftRun=scifive-ft2026.03 | — | — | — | — | — | — | 25 | 25 | 0 | 0 | 61.67 | 63.33 | 0 | 0 | |
| SIB-task-a-1Run=SIB-task-a-12026.03 | — | — | — | — | — | — | 30 | 33.33 | 0 | 0 | 55 | 55 | 0 | 0 | |
| task_a_outputRun=task_a_output2026.03 | — | — | — | — | — | — | 30 | 33.33 | 8.33 | 10 | 55 | 55 | 8.33 | 10 | |
| task_a_run4Run=task_a_run42026.03 | — | — | — | — | — | — | 30 | 30 | 6.67 | 6.67 | 61.67 | 61.67 | 6.67 | 6.67 |