Token Cost Evaluation on MedQA (Medical Reasoning)
1,742Token CostDyLAN
Evaluation Results
| Method | Links | |
|---|---|---|
| DyLANModel=GPT-4o, Framework=DyLAN2025.08 | 1,742 | |
| ReConcileModel=GPT-4o, Framework=ReConcile2025.08 | 1,988 | |
| TMA-AllComponModel=MedGemma-4B, Framework=TMA-AllCompon2025.08 | 2,402 | |
| TMA-AllComponModel=Gemma-3-4B, Framework=TMA-AllCompon2025.08 | 2,402 | |
| TMA-AllComponModel=GPT-4o, Framework=TMA-AllCompon2025.08 | 2,402 | |
| ReConcileModel=Gemma-3-4B, Framework=ReConcile2025.08 | 5,072 | |
| DyLANModel=Gemma-3-4B, Framework=DyLAN2025.08 | 6,091 | |
| MedAgentsModel=Gemma-3-4B, Framework=MedAgents2025.08 | 10,466 | |
| MedAgentsModel=GPT-4o, Framework=MedAgents2025.08 | 10,466 | |
| MDAgentsModel=GPT-4o, Framework=MDAgents2025.08 | 19,549 | |
| MDAgentsModel=Gemma-3-4B, Framework=MDAgents2025.08 | 24,492 |