Scan-level report labelling on Stenosis (test)
96.3Balanced AccuracyDirect Query
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Direct QueryQuery Model=Llama32024.10 | 96.3 | 0 | 0.987 | 96.2 | |
| Direct QueryQuery Model=GPT-42024.10 | 95.1 | — | — | 94.9 | |
| Direct QueryQuery Model=Zephyr2024.10 | 94.5 | 0.037 | 0.981 | 95 | |
| Summary-QuerySummary Model=Zephyr, Query Model=Zephyr2024.10 | 94.5 | 0.111 | 0.985 | 95 | |
| Summary-QuerySummary Model=Llama3, Query Model=Llama32024.10 | 94.5 | 0.037 | 0.995 | 95 | |
| Summary-QuerySummary Model=Z-SFT, Query Model=Zephyr2024.10 | 93.3 | 0.037 | 0.943 | 93.7 |