Token Cost Evaluation on MedMCQA
1,047Token Cost (tokens/question)DyLAN
Evaluation Results
| Method | Links | |
|---|---|---|
| DyLANModel=GPT-4o, Framework=DyLAN2025.08 | 1,047 | |
| ReConcileModel=GPT-4o, Framework=ReConcile2025.08 | 1,318 | |
| MDAgentsModel=GPT-4o, Framework=MDAgents2025.08 | 2,405 | |
| TMA-AllComponModel=MedGemma-4B, Framework=TMA-AllCompon2025.08 | 2,410 | |
| TMA-AllComponModel=Gemma-3-4B, Framework=TMA-AllCompon2025.08 | 2,410 | |
| TMA-AllComponModel=GPT-4o, Framework=TMA-AllCompon2025.08 | 2,410 | |
| ReConcileModel=Gemma-3-4B, Framework=ReConcile2025.08 | 3,651 | |
| DyLANModel=Gemma-3-4B, Framework=DyLAN2025.08 | 4,275 | |
| MedAgentsModel=Gemma-3-4B, Framework=MedAgents2025.08 | 10,103 | |
| MedAgentsModel=GPT-4o, Framework=MedAgents2025.08 | 10,103 | |
| MDAgentsModel=Gemma-3-4B, Framework=MDAgents2025.08 | 12,623 |