List your company
ResearchFormerly WizWand

Medical Knowledge on MedQA

92.8AccuracyPROMPTED
43.462456.271269.0881.8888Oct 3, 2023Feb 13, 2024Jun 25, 2024Nov 5, 2024Mar 18, 2025Jul 29, 2025Dec 10, 2025
Updated 8mo ago

Evaluation results

MethodLinks
PROMPTEDPrompting Technique=PROMPTED2023.1092.8
Output RefinementPrompting Technique=Output Refinement2023.1090.4
Fine-Tuned GPT-4o + MedBioRAGBackbone=GPT-4o, Fine-tuned=true, RAG=MedBioRAG2025.1289.47
Zero-Shot CoTPrompting Technique=Zero-Shot Chain-of-Thought2023.1088.8
Fine-Tuned GPT-4oBackbone=GPT-4o, Fine-tuned=true2025.1287.88
GPT-4o + MedBioRAGBackbone=GPT-4o, Fine-tuned=false, RAG=MedBioRAG2025.1286.86
Zero-ShotPrompting Technique=Zero-Shot2023.1086.8
GPT-4oBackbone=GPT-4o, Fine-tuned=false2025.1281.82
GPT-4 + MedBioRAGBackbone=GPT-4, Fine-tuned=false, RAG=MedBioRAG2025.1278.79
GPT-4o-mini + MedBioRAGBackbone=GPT-4o-mini, Fine-tuned=false, RAG=MedBioRAG2025.1270.71
GPT-4o-miniBackbone=GPT-4o-mini, Fine-tuned=false2025.1267.68
GPT-4Backbone=GPT-4, Fine-tuned=false2025.1266.67
Mistral 8x7BParameters=8x7B, Shots=2-shot2024.1062.2
Llama 3 8BParameters=8B, Shots=2-shot2024.1060.5
Shakti-LLMParameters=2.5B, Shots=2-shot2024.1060.3
Phi-3 Mini-4kShots=2-shot2024.1053.8
GPT-3.5Backbone=GPT-3.5, Fine-tuned=false2025.1251.52
Mistral 7BParameters=7B, Shots=2-shot2024.1050
Gemma 7BParameters=7B, Shots=2-shot2024.1049.6
GPT-3.5 + MedBioRAGBackbone=GPT-3.5, Fine-tuned=false, RAG=MedBioRAG2025.1245.36