CPT Code Coverage Adjudication on CPT codes (val)
94AccuracyGPT-5-mini
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-5-miniContext Provided=Retrieved text, Retriever=Finetuned (FR)2026.01 | 94 | 96 | 440 | — | |
| O3Context Provided=Retrieved text, Retriever=Finetuned (FR)2026.01 | 94 | 96 | 880 | — | |
| GPT-4.1Context Provided=Retrieved text, Retriever=Finetuned (FR)2026.01 | 92 | 95 | 880 | — | |
| Rule-basedContext Provided=Retrieved text, Retriever=Finetuned (FR)2026.01 | 87 | 93 | 2 | 22 | |
| Rule-basedContext Provided=Retrieved text, Retriever=Zero-shot (ZR)2026.01 | 85 | 91 | 2 | 22 | |
| GPT-4.1Context Provided=Entire document2026.01 | 82 | 89 | — | — |