Agent Verification on MIMIC-IV Cholecystitis
0.9648AUROCGLEAN + Active (εu = 0.0)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GLEAN + Active (εu = 0.0)Agent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.9648 | 0.0379 | 0.075 | 0.0753 | |
| GLEAN + Active (εu = 0.5)Agent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.9582 | 0.048 | 0.0696 | 0.0753 | |
| GLEAN (K = 3)Agent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.9559 | 0.0505 | 0.0718 | 0.079 | |
| GLEAN + Active (εu = 0.0)Agent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.9159 | 0.0886 | 0.1206 | 0.1116 | |
| GLEAN + Active (εu = 0.5)Agent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.9063 | 0.0962 | 0.1067 | 0.1124 | |
| GLEAN (K = 3)Agent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.8929 | 0.0987 | 0.0893 | 0.1174 | |
| GLEAN (K = 1)Agent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.8888 | 0.1111 | 0.0849 | 0.1314 | |
| GLEAN (K = 1)Agent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.8524 | 0.1089 | 0.0641 | 0.1495 | |
| Self-ConsistencyAgent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.8493 | 0.1439 | 0.1019 | 0.1534 | |
| Semantic EntropyAgent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.8448 | 0.1566 | — | — | |
| ORMAgent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.8332 | 0.1555 | 0.1922 | 0.2146 | |
| ORMAgent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.819 | 0.1364 | 0.1283 | 0.1846 | |
| Self-ConsistencyAgent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.7978 | 0.1646 | 0.0834 | 0.1484 | |
| Self-VerificationAgent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.7907 | 0.2045 | 0.1495 | 0.2057 | |
| RAG-AugmentedAgent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.7896 | 0.1894 | 0.2575 | 0.2709 | |
| Semantic EntropyAgent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.7772 | 0.1747 | — | — | |
| Self-VerificationAgent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.7576 | 0.1722 | 0.221 | 0.2299 | |
| RAG-AugmentedAgent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.7571 | 0.1899 | 0.2491 | 0.2598 | |
| LLM-as-a-JudgeAgent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.7548 | 0.2197 | 0.0657 | 0.2007 | |
| Med-PRMAgent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.7519 | 0.2146 | 0.367 | 0.3626 | |
| P(TRUE)Agent Backbone=Qwen3-30B-A3B-Instruct2026.03 | 0.7384 | 0.2222 | 0.2758 | 0.2927 | |
| Med-PRMAgent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.6475 | 0.2582 | 0.301 | 0.3107 | |
| LLM-as-a-JudgeAgent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.6426 | 0.2557 | 0.0917 | 0.2259 | |
| P(TRUE)Agent Backbone=Qwen2.5-7B-Instruct2026.03 | 0.6225 | 0.281 | 0.364 | 0.3715 |