Semantic Alignment Evaluation on Expert-labeled feature relevance dataset
92.2T1D ScorePPMI-SVD
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PPMI-SVDSource Institution=BCH2025.02 | 92.2 | 89.7 | — | 83 | 90.3 | 85.2 | 88.1 | |
| GPT-4Description=GPT-4-assigned scores alignment2025.02 | 88.5 | 93.7 | 82.8 | 84.5 | 96.2 | 96.4 | 90.3 | |
| GAME2025.02 | 87.3 | 93.2 | 72.4 | 87.5 | 91.1 | 77.3 | 84.8 | |
| PPMI-SVDSource Institution=UPMC2025.02 | 86.6 | 88.5 | 71.3 | 72.9 | 84.9 | 83.1 | 81.2 | |
| OpenAI2025.02 | 85.6 | 86.1 | 62.8 | 83.1 | 58.6 | 77.1 | 75.5 | |
| PPMI-SVDSource Institution=VA2025.02 | 83.2 | 87.3 | 78.9 | 80.8 | 90.8 | 83.8 | 84.1 | |
| CODER2025.02 | 80.3 | 80.8 | 59.5 | 67.6 | 69.4 | 59.2 | 69.5 | |
| PPMI-SVDSource Institution=BDX2025.02 | 79.9 | 93.8 | 70.7 | 79.3 | 88.5 | 78 | 81.7 | |
| PPMI-SVDSource Institution=AVE2025.02 | 75.9 | 87.1 | 70 | 75.5 | 86.3 | 80.6 | 79.2 | |
| SBERT2025.02 | 75.8 | 80.4 | 45.4 | 66.2 | 68.2 | 76.4 | 68.7 | |
| BGE2025.02 | 72.1 | 72.8 | 60.8 | 64.3 | 84 | 80.1 | 72.4 | |
| PPMI-SVDSource Institution=MGB2025.02 | 69.7 | 88.2 | 78.1 | 76.8 | 89.1 | 81.6 | 80.6 | |
| PPMI-SVDSource Institution=Duke2025.02 | 61.9 | 86 | — | 72.5 | 82.6 | 88.5 | 78.3 | |
| PPMI-SVDSource Institution=MIMIC2025.02 | 57.7 | 76.3 | 51.2 | 63.2 | 77.6 | 64.1 | 65 | |
| PBERT2025.02 | 52.4 | 52.6 | 41.7 | 49.2 | 47.7 | 83.9 | 54.6 | |
| BBERT2025.02 | 43.1 | 60.7 | 49.7 | 63.9 | 66.5 | 48.6 | 55.4 |