Token Cost Evaluation on PubMedQA
1,509Token Cost (tokens/question)TMA-AllCompon
Evaluation Results
| Method | Links | |
|---|---|---|
| TMA-AllComponModel=MedGemma-4B, Framework=TMA-AllCompon2025.08 | 1,509 | |
| TMA-AllComponModel=Gemma-3-4B, Framework=TMA-AllCompon2025.08 | 1,509 | |
| TMA-AllComponModel=GPT-4o, Framework=TMA-AllCompon2025.08 | 1,509 | |
| DyLANModel=GPT-4o, Framework=DyLAN2025.08 | 2,652 | |
| ReConcileModel=GPT-4o, Framework=ReConcile2025.08 | 3,579 | |
| ReConcileModel=Gemma-3-4B, Framework=ReConcile2025.08 | 6,621 | |
| DyLANModel=Gemma-3-4B, Framework=DyLAN2025.08 | 9,621 | |
| MDAgentsModel=Gemma-3-4B, Framework=MDAgents2025.08 | 17,654 | |
| MedAgentsModel=Gemma-3-4B, Framework=MedAgents2025.08 | 24,471 | |
| MedAgentsModel=GPT-4o, Framework=MedAgents2025.08 | 24,471 | |
| MDAgentsModel=GPT-4o, Framework=MDAgents2025.08 | 27,937 |