Medical Reasoning on MedBullets (Token Cost)
2,391Token Cost (tokens/question)TMA-AllCompon
Evaluation Results
| Method | Links | |
|---|---|---|
| TMA-AllComponModel=MedGemma-4B, Framework=TMA-AllCompon2025.08 | 2,391 | |
| TMA-AllComponModel=Gemma-3-4B, Framework=TMA-AllCompon2025.08 | 2,391 | |
| TMA-AllComponModel=GPT-4o, Framework=TMA-AllCompon2025.08 | 2,391 | |
| DyLANModel=GPT-4o, Framework=DyLAN2025.08 | 2,461 | |
| ReConcileModel=GPT-4o, Framework=ReConcile2025.08 | 2,816 | |
| DyLANModel=Gemma-3-4B, Framework=DyLAN2025.08 | 7,171 | |
| ReConcileModel=Gemma-3-4B, Framework=ReConcile2025.08 | 7,336 | |
| MedAgentsModel=Gemma-3-4B, Framework=MedAgents2025.08 | 19,550 | |
| MedAgentsModel=GPT-4o, Framework=MedAgents2025.08 | 19,550 | |
| MDAgentsModel=Gemma-3-4B, Framework=MDAgents2025.08 | 25,969 | |
| MDAgentsModel=GPT-4o, Framework=MDAgents2025.08 | 25,969 |