List your company
ResearchFormerly WizWand

Token Cost Evaluation on MedQA (Medical Reasoning)

1,742Token CostDyLAN
8326,974.513,11719,259.5Aug 11, 2025
Updated 7mo ago

Evaluation results

MethodLinks
DyLANModel=GPT-4o, Framework=DyLAN2025.081,742
ReConcileModel=GPT-4o, Framework=ReConcile2025.081,988
TMA-AllComponModel=MedGemma-4B, Framework=TMA-AllCompon2025.082,402
TMA-AllComponModel=Gemma-3-4B, Framework=TMA-AllCompon2025.082,402
TMA-AllComponModel=GPT-4o, Framework=TMA-AllCompon2025.082,402
ReConcileModel=Gemma-3-4B, Framework=ReConcile2025.085,072
DyLANModel=Gemma-3-4B, Framework=DyLAN2025.086,091
MedAgentsModel=Gemma-3-4B, Framework=MedAgents2025.0810,466
MedAgentsModel=GPT-4o, Framework=MedAgents2025.0810,466
MDAgentsModel=GPT-4o, Framework=MDAgents2025.0819,549
MDAgentsModel=Gemma-3-4B, Framework=MDAgents2025.0824,492