Feature Selection Alignment on Expert-labeled disease feature relevance dataset
92.2T1D Alignment ScorePPMI-SVD (BCH)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PPMI-SVD (BCH)Embedding Method=PPMI-SVD, Institution=BCH2025.02 | 92.2 | 89.7 | — | 83 | 90.3 | 85.2 | 88.1 | |
| GPT-4Role=Expert-assigned score proxy2025.02 | 88.5 | 93.7 | 82.8 | 84.5 | 96.2 | 96.4 | 90.3 | |
| PPMI-SVD (UPMC)Embedding Method=PPMI-SVD, Institution=UPMC2025.02 | 86.6 | 88.5 | 71.3 | 72.9 | 84.9 | 83.1 | 81.2 | |
| OpenAIEmbedding Source=OpenAI2025.02 | 85.6 | 86.1 | 62.8 | 83.5 | 58.6 | 77.1 | 75.6 | |
| Ablation (g)variant=(g)2025.02 | 84.5 | 91.1 | 79.8 | 82 | 91.5 | 85.3 | 85.7 | |
| PPMI-SVD (VA)Embedding Method=PPMI-SVD, Institution=VA2025.02 | 82.6 | 89.9 | 81.1 | 73.5 | 89.2 | 76.5 | 82.1 | |
| GAMEBackbone=LLM2025.02 | 82.3 | 92.8 | 84.1 | 82.2 | 92.8 | 83.4 | 86.3 | |
| Ablation (a)variant=(a)2025.02 | 81.5 | 89.1 | 67 | 81.8 | 85.3 | 77.8 | 80.4 | |
| GAME (CODER)Backbone=CODER2025.02 | 80.9 | 93.1 | 79.2 | 84.5 | 91.1 | 82.5 | 85.2 | |
| CODER2025.02 | 80.3 | 80.8 | 59.5 | 67.6 | 69.4 | 59.2 | 69.5 | |
| PPMI-SVD (BDX)Embedding Method=PPMI-SVD, Institution=BDX2025.02 | 79.9 | 93.8 | 70.7 | 79.3 | 88.5 | 78 | 81.7 | |
| GAME (BGE)Backbone=BGE2025.02 | 79.5 | 92.3 | 79.7 | 83.5 | 94.1 | 85.3 | 85.7 | |
| Ablation (h)variant=(h)2025.02 | 79.5 | 91.9 | 70.1 | 79.9 | 94.5 | 83.4 | 83.2 | |
| Ablation (e)variant=(e)2025.02 | 77.8 | 91.2 | 80.1 | 82.4 | 91.1 | 84.4 | 84.5 | |
| PPMI-SVD (AVE)Embedding Method=PPMI-SVD, Institution=Average across institutions2025.02 | 77.7 | 87.4 | 75.3 | 76.3 | 87.2 | 83.5 | 81.3 | |
| Ablation (b)variant=(b)2025.02 | 77.7 | 88.9 | 67 | 80.2 | 90.3 | 79.4 | 80.6 | |
| Ablation (f)variant=(f)2025.02 | 77 | 91.6 | 81.2 | 82.9 | 88.2 | 83.9 | 84.1 | |
| Ablation (c)variant=(c)2025.02 | 76.7 | 89.8 | 69.3 | 83.5 | 92.8 | 79.6 | 82 | |
| SBERT2025.02 | 75.8 | 80.4 | 45.4 | 66.2 | 68.2 | 76.4 | 68.7 | |
| Ablation (d)variant=(d)2025.02 | 75 | 89.6 | 78.6 | 82.1 | 91.5 | 78.7 | 82.6 | |
| BGE2025.02 | 72.1 | 72.8 | 60.8 | 64.3 | 84 | 80.1 | 72.4 | |
| PPMI-SVD (MIMIC)Embedding Method=PPMI-SVD, Institution=MIMIC2025.02 | 71.3 | 75.9 | — | — | 86.2 | 91.8 | 81.3 | |
| PPMI-SVD (MGB)Embedding Method=PPMI-SVD, Institution=MGB2025.02 | 69.7 | 88.2 | 78.1 | 76.8 | 89.1 | 81.6 | 80.6 | |
| PPMI-SVD (Duke)Embedding Method=PPMI-SVD, Institution=Duke2025.02 | 61.9 | 86 | — | 72.5 | 82.6 | 88.5 | 78.3 | |
| PBERT2025.02 | 52.4 | 52.6 | 41.7 | 49.2 | 47.7 | 83.9 | 54.6 | |
| BBERT2025.02 | 43.1 | 60.7 | 49.7 | 63.9 | 66.5 | 48.6 | 55.4 |