Rare Disease Diagnosis on RareBench Qwen-0.8B text (test)
85.6Hit@1REPAIR
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| REPAIRBase Model=Qwen-0.8B, text, Shortlist size=102026.04 | 85.6 | 92.5 | 89.9 | 81.2 | 90.7 | 70.8 | |
| ClasswiseBase Model=Qwen-0.8B, text, Shortlist size=102026.04 | 66.2 | 91.2 | 78.9 | 54.1 | 80 | 21.5 | |
| LogitAdjBase Model=Qwen-0.8B, text, Shortlist size=102026.04 | 62.5 | 71.9 | 71.2 | 52.9 | 73.3 | 38.5 | |
| BaseBase Model=Qwen-0.8B, text, Shortlist size=102026.04 | 59.4 | 75 | 71.2 | 41.2 | 80 | — | |
| τ-normBase Model=Qwen-0.8B, text, Shortlist size=102026.04 | 56.2 | 78.1 | 70.2 | 41.2 | 73.3 | 0 |