List your company
ResearchFormerly WizWand

Question Answering on HeadQA

93.4AccuracyDeepSeek-R1
26.569643.919861.2778.6202May 11, 2023Nov 18, 2023May 27, 2024Dec 4, 2024Jun 13, 2025Dec 21, 2025Jul 1, 2026
Updated 4mo ago

Evaluation results

MethodLinks
DeepSeek-R1Backbone=DeepSeek-R12026.0793.4
Claude Sonnet 4.5Backbone=Claude Sonnet 4.52026.0791
FaithMed (Qwen3 4B)Backbone=Qwen3 4B2026.0785.7
Agentic Search + GRPO (Qwen3 4B)Backbone=Qwen3 4B2026.0784.4
MedGemma 27BBackbone=MedGemma 27B2026.0784
MedRAG (Qwen3 4B)Backbone=Qwen3 4B2026.0783.9
Qwen3 8BBackbone=Qwen3 8B2026.0783.4
Agentic Search (Qwen3 4B)Backbone=Qwen3 4B2026.0781.5
Base (Qwen3 4B)Backbone=Qwen3 4B2026.0781.3
AttributionIteration=1, Selection Ratio=0.22026.0480.56
DiversityIteration=2, Selection Ratio=0.52026.0480.45
DiversityIteration=2, Selection Ratio=0.22026.0480.38
AllIteration=12026.0480.23
EVOSELECTIteration=1, Selection Ratio=0.22026.0480.2
EVOSELECTIteration=2, Selection Ratio=0.52026.0480.16
EVOSELECTIteration=1, Selection Ratio=0.52026.0480.05
Attr-DivIteration=2, Selection Ratio=0.22026.0480.05
DiversityIteration=1, Selection Ratio=0.22026.0480.01
EVOSELECTIteration=2, Selection Ratio=0.22026.0479.98
RandomIteration=1, Selection Ratio=0.22026.0479.94
AttributionIteration=1, Selection Ratio=0.52026.0479.94
AttributionIteration=2, Selection Ratio=0.52026.0479.94
TSDSIteration=2, Selection Ratio=0.22026.0479.91
Attr-DivIteration=1, Selection Ratio=0.52026.0479.87
Attr-DivIteration=1, Selection Ratio=0.22026.0479.8
DiversityIteration=1, Selection Ratio=0.52026.0479.76
Attr-DivIteration=2, Selection Ratio=0.52026.0479.76
RandomIteration=2, Selection Ratio=0.52026.0479.69
AttributionIteration=2, Selection Ratio=0.22026.0479.69
TSDSIteration=1, Selection Ratio=0.52026.0479.65
RandomIteration=2, Selection Ratio=0.22026.0479.58
AllIteration=22026.0479.5
TSDSIteration=2, Selection Ratio=0.52026.0479.5
TSDSIteration=1, Selection Ratio=0.22026.0479.47
RandomIteration=1, Selection Ratio=0.52026.0479.43
Base2026.0478.01
FaithMed (Qwen3 1.7B)Backbone=Qwen3 1.7B2026.0775.6
Gemma 3 12BBackbone=Gemma 3 12B2026.0773
Agentic Search + GRPO (Qwen3 1.7B)Backbone=Qwen3 1.7B2026.0768.5
Llama 3.1 8B InstructBackbone=Llama 3.1 8B2026.0767.6
MedRAG (Qwen3 1.7B)Backbone=Qwen3 1.7B2026.0767.5
Attr-DivIteration=1, Selection Ratio=0.2, Backbone=3b base model2026.0466.59
TSDSIteration=2, Selection Ratio=0.2, Backbone=3b base model2026.0466.56
AllIteration=2, Selection Ratio=All, Backbone=3b base model2026.0466.52
AttributionIteration=2, Selection Ratio=0.2, Backbone=3b base model2026.0466.48
EVOSELECTIteration=2, Selection Ratio=0.2, Backbone=3b base model2026.0466.45
EVOSELECTIteration=2, Selection Ratio=0.5, Backbone=3b base model2026.0466.41
AttributionIteration=2, Selection Ratio=0.5, Backbone=3b base model2026.0466.37
Base (Qwen3 1.7B)Backbone=Qwen3 1.7B2026.0766.2
EVOSELECTIteration=1, Selection Ratio=0.2, Backbone=3b base model2026.0466.19
AttributionIteration=1, Selection Ratio=0.2, Backbone=3b base model2026.0466.08
TSDSIteration=1, Selection Ratio=0.2, Backbone=3b base model2026.0466.01
RandomIteration=1, Selection Ratio=0.2, Backbone=3b base model2026.0465.97
EVOSELECTIteration=1, Selection Ratio=0.5, Backbone=3b base model2026.0465.9
RandomIteration=2, Selection Ratio=0.2, Backbone=3b base model2026.0465.9
RandomIteration=1, Selection Ratio=0.5, Backbone=3b base model2026.0465.79
TSDSIteration=2, Selection Ratio=0.5, Backbone=3b base model2026.0465.75
TSDSIteration=1, Selection Ratio=0.5, Backbone=3b base model2026.0465.68
Attr-DivIteration=2, Selection Ratio=0.2, Backbone=3b base model2026.0465.68
Attr-DivIteration=1, Selection Ratio=0.5, Backbone=3b base model2026.0465.57
Agentic Search (Qwen3 1.7B)Backbone=Qwen3 1.7B2026.0765.5
DiversityIteration=2, Selection Ratio=0.2, Backbone=3b base model2026.0465.43
AttributionIteration=1, Selection Ratio=0.5, Backbone=3b base model2026.0465.32
DiversityIteration=1, Selection Ratio=0.2, Backbone=3b base model2026.0465.24
RandomIteration=2, Selection Ratio=0.5, Backbone=3b base model2026.0465.21
BaseIteration=Base, Backbone=3b base model2026.0465.1
DiversityIteration=1, Selection Ratio=0.5, Backbone=3b base model2026.0465.03
Attr-DivIteration=2, Selection Ratio=0.5, Backbone=3b base model2026.0464.92
Full FTBase model=gpt-oss 20B, Trainable Parameters=100.0%2026.0464.9
AllIteration=1, Selection Ratio=All, Backbone=3b base model2026.0464.77
DiversityIteration=2, Selection Ratio=0.5, Backbone=3b base model2026.0464.77
MPTBase model=gpt-oss 20B, Trainable Parameters=<0.05%2026.0464.4
LoRABase model=gpt-oss 20B, Trainable Parameters=~2.50%2026.0462.9
Full FTBase model=Meditron3 8B, Trainable Parameters=100.0%2026.0460.3
MPTBase model=Meditron3 8B, Trainable Parameters=<0.05%2026.0459.5
PTBase model=gpt-oss 20B, Trainable Parameters=<0.05%2026.0458.5
Full FTBase model=LLaMA 3.1 8B, Trainable Parameters=100.0%2026.0458.4
LoRABase model=Meditron3 8B, Trainable Parameters=~2.50%2026.0458.1
MPTBase model=LLaMA 3.1 8B, Trainable Parameters=<0.05%2026.0457.3
LoRABase model=LLaMA 3.1 8B, Trainable Parameters=~2.50%2026.0456
PTBase model=Meditron3 8B, Trainable Parameters=<0.05%2026.0453.5
PTBase model=LLaMA 3.1 8B, Trainable Parameters=<0.05%2026.0451.2
OLTQAFull Config=True2023.0534.48
UnifiedQA2023.0529.14