Natural Language to FHIRPath query generation on FHIRPath-QA Patient perspective
41Accuracyo1-preview
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| o1-previewArchitecture Strategy=Retrieval2026.02 | 41 | 14 | 48 | |
| o1-miniArchitecture Strategy=Query-first2026.02 | 38 | 15 | 45 | |
| o1-miniArchitecture Strategy=Retrieval2026.02 | 33 | 34 | 49 | |
| 4o-miniArchitecture Strategy=Query-first2026.02 | 28 | 9 | 31 | |
| o1-previewArchitecture Strategy=Query-first2026.02 | 27 | 23 | 35 | |
| 4o-miniArchitecture Strategy=Retrieval2026.02 | 15 | 40 | 25 |