Clinical trial outcome prediction on ClinicalTrials.gov (In-Distribution Seen Interventions)
64.2AccuracyBioBERT
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BioBERTTraining Data=Hybrid, Evaluation Context=In-Distribution2024.10 | 64.2 | 66.2 | 64.2 | 69.8 | 72.5 | |
| BioBERTTraining Data=100% Real, Evaluation Context=Ratio Mix2024.10 | 63.8 | 69.5 | 54.2 | 70.2 | 72.8 | |
| BioBERTTraining Data=Real-Only, Evaluation Context=In-Distribution2024.10 | 63.3 | 67.7 | 56.3 | 68.9 | 72.3 | |
| BioBERTTraining Data=20% Syn + 80% Real, Evaluation Context=Ratio Mix2024.10 | 62.9 | 64.2 | 67.8 | 69.2 | 70.8 | |
| BioBERTTraining Data=40% Syn + 60% Real, Evaluation Context=Ratio Mix2024.10 | 62 | 62.3 | 68.9 | 67 | 68.9 | |
| BioBERTTraining Data=60% Syn + 40% Real, Evaluation Context=Ratio Mix2024.10 | 60.8 | 62 | 64 | 64.8 | 66.7 | |
| BioBERTTraining Data=80% Syn + 20% Real, Evaluation Context=Ratio Mix2024.10 | 58.6 | 59.4 | 66.5 | 62 | 63.8 | |
| BioBERTTraining Data=100% Synthetic, Evaluation Context=Ratio Mix2024.10 | 54.5 | 54.3 | 82.5 | 56.6 | 58.9 | |
| BioBERTTraining Data=Synthetic-Only, Evaluation Context=In-Distribution2024.10 | 53.4 | 53.2 | 87.3 | 55.9 | 58.4 | |
| BioBERTTraining Data=No Fine-Tuning, Evaluation Context=In-Distribution2024.10 | 52.7 | 52.6 | 93.7 | 51.7 | 53.1 |