# Semantic Alignment Evaluation on Expert-labeled feature relevance dataset Source: [Semantic Alignment Evaluation on Expert-labeled feature relevance dataset]() Collection index: [llms.txt]() Data updated: 2026-04-07T07:06:44.780Z Evaluation of model performance on the Expert-labeled feature relevance dataset using Semantic Alignment criteria, reporting metrics related to specific conditions (e.g., T1D, Epilepsy, Asthma). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Semantic Alignment Evaluation | | Dataset (including any stated split) | Expert-labeled feature relevance dataset | | Metric | T1D Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [T1D Score](): Higher is better; unit: PERCENT. - [Epilepsy Score](): Higher is better; unit: PERCENT. - [PH Score](): Higher is better; unit: PERCENT. - [Asthma Score](): Higher is better; unit: PERCENT. - [CD Score](): Higher is better; unit: PERCENT. - [UC Score](): Higher is better; unit: PERCENT. - [AVE Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | T1D Score | Result date | Report paper | | --- | --- | --- | --- | | PPMI-SVD | 92.2 | Not recorded | 68fa76f31e209131cea7034e | | GPT-4 | 88.5 | Not recorded | 68fa76f31e209131cea7034e | | GAME | 87.3 | Not recorded | 68fa76f31e209131cea7034e | | PPMI-SVD | 86.6 | Not recorded | 68fa76f31e209131cea7034e | | OpenAI | 85.6 | Not recorded | 68fa76f31e209131cea7034e | | PPMI-SVD | 83.2 | Not recorded | 68fa76f31e209131cea7034e | | CODER | 80.3 | Not recorded | 68fa76f31e209131cea7034e | | PPMI-SVD | 79.9 | Not recorded | 68fa76f31e209131cea7034e | | PPMI-SVD | 75.9 | Not recorded | 68fa76f31e209131cea7034e | | SBERT | 75.8 | Not recorded | 68fa76f31e209131cea7034e | | BGE | 72.1 | Not recorded | 68fa76f31e209131cea7034e | | PPMI-SVD | 69.7 | Not recorded | 68fa76f31e209131cea7034e | | PPMI-SVD | 61.9 | Not recorded | 68fa76f31e209131cea7034e | | PPMI-SVD | 57.7 | Not recorded | 68fa76f31e209131cea7034e | | PBERT | 52.4 | Not recorded | 68fa76f31e209131cea7034e | | BBERT | 43.1 | Not recorded | 68fa76f31e209131cea7034e | ### PPMI-SVD T1D Score: 92.2. Result ID: 69d4ace747f34ce924bbfbf1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Source Institution":"BCH"}. This record does not assert independent reproduction. ### GPT-4 T1D Score: 88.5. Result ID: 69d4ace747f34ce924bbfc00. [Reporting paper]() Recorded evaluation configuration: {"Description":"GPT-4-assigned scores alignment"}. This record does not assert independent reproduction. ### GAME T1D Score: 87.3. Result ID: 69d4ace747f34ce924bbfbff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### PPMI-SVD T1D Score: 86.6. Result ID: 69d4ace747f34ce924bbfbf6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Source Institution":"UPMC"}. This record does not assert independent reproduction. ### OpenAI T1D Score: 85.6. Result ID: 69d4ace747f34ce924bbfbfe. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### PPMI-SVD T1D Score: 83.2. Result ID: 69d4ace747f34ce924bbfbf7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Source Institution":"VA"}. This record does not assert independent reproduction. ### CODER T1D Score: 80.3. Result ID: 69d4ace747f34ce924bbfbfc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### PPMI-SVD T1D Score: 79.9. Result ID: 69d4ace747f34ce924bbfbf2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Source Institution":"BDX"}. This record does not assert independent reproduction. ### PPMI-SVD T1D Score: 75.9. Result ID: 69d4ace747f34ce924bbfbf8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Source Institution":"AVE"}. This record does not assert independent reproduction. ### SBERT T1D Score: 75.8. Result ID: 69d4ace747f34ce924bbfbfb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### BGE T1D Score: 72.1. Result ID: 69d4ace747f34ce924bbfbfd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### PPMI-SVD T1D Score: 69.7. Result ID: 69d4ace747f34ce924bbfbf4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Source Institution":"MGB"}. This record does not assert independent reproduction. ### PPMI-SVD T1D Score: 61.9. Result ID: 69d4ace747f34ce924bbfbf3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Source Institution":"Duke"}. This record does not assert independent reproduction. ### PPMI-SVD T1D Score: 57.7. Result ID: 69d4ace747f34ce924bbfbf5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Source Institution":"MIMIC"}. This record does not assert independent reproduction. ### PBERT T1D Score: 52.4. Result ID: 69d4ace747f34ce924bbfbfa. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### BBERT T1D Score: 43.1. Result ID: 69d4ace747f34ce924bbfbf9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.