Natural Language to FHIRPath query generation on FHIRPath-QA Clinical perspective
42Accuracyo1-preview
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| o1-previewArchitecture Strategy=Retrieval2026.02 | 42 | 17 | 50 | |
| o1-miniArchitecture Strategy=Query-first2026.02 | 35 | 9 | 39 | |
| o1-miniArchitecture Strategy=Retrieval2026.02 | 33 | 36 | 51 | |
| o1-previewArchitecture Strategy=Query-first2026.02 | 25 | 15 | 29 | |
| 4o-miniArchitecture Strategy=Query-first2026.02 | 25 | 2 | 26 | |
| 4o-miniArchitecture Strategy=Retrieval2026.02 | 24 | 46 | 45 |