List your company
ResearchFormerly WizWand

Token Cost Evaluation on PubMedQA

1,509Token Cost (tokens/question)TMA-AllCompon
451.887,587.4414,72321,858.56Aug 11, 2025
Updated 7mo ago

Evaluation results

MethodLinks
TMA-AllComponModel=MedGemma-4B, Framework=TMA-AllCompon2025.081,509
TMA-AllComponModel=Gemma-3-4B, Framework=TMA-AllCompon2025.081,509
TMA-AllComponModel=GPT-4o, Framework=TMA-AllCompon2025.081,509
DyLANModel=GPT-4o, Framework=DyLAN2025.082,652
ReConcileModel=GPT-4o, Framework=ReConcile2025.083,579
ReConcileModel=Gemma-3-4B, Framework=ReConcile2025.086,621
DyLANModel=Gemma-3-4B, Framework=DyLAN2025.089,621
MDAgentsModel=Gemma-3-4B, Framework=MDAgents2025.0817,654
MedAgentsModel=Gemma-3-4B, Framework=MedAgents2025.0824,471
MedAgentsModel=GPT-4o, Framework=MedAgents2025.0824,471
MDAgentsModel=GPT-4o, Framework=MDAgents2025.0827,937