List your company
ResearchFormerly WizWand

Token Cost on MMLU-Pro (Medical Reasoning)

1,350Token Cost (tokens/question)DyLAN
561.725,882.6111,203.516,524.39Aug 11, 2025
Updated 7mo ago

Evaluation results

MethodLinks
DyLANModel=GPT-4o, Framework=DyLAN2025.081,350
ReConcileModel=GPT-4o, Framework=ReConcile2025.081,925
TMA-AllComponModel=MedGemma-4B, Framework=TMA-AllCompon2025.083,427
TMA-AllComponModel=Gemma-3-4B, Framework=TMA-AllCompon2025.083,427
TMA-AllComponModel=GPT-4o, Framework=TMA-AllCompon2025.083,427
ReConcileModel=Gemma-3-4B, Framework=ReConcile2025.086,271
DyLANModel=Gemma-3-4B, Framework=DyLAN2025.087,977
MedAgentsModel=Gemma-3-4B, Framework=MedAgents2025.0810,362
MedAgentsModel=GPT-4o, Framework=MedAgents2025.0810,362
MDAgentsModel=Gemma-3-4B, Framework=MDAgents2025.0821,057
MDAgentsModel=GPT-4o, Framework=MDAgents2025.0821,057