Question Answering on MedMCQA (test)
0.163Test Error RateGreedy MI
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Greedy MIk=42026.02 | 0.163 | — | — | — | — | |
| Greedy MIk=52026.02 | 0.163 | — | — | — | — | |
| Greedy MIk=32026.02 | 0.164 | — | — | — | — | |
| Greedy MIk=62026.02 | 0.164 | — | — | — | — | |
| Greedy MIk=72026.02 | 0.167 | — | — | — | — | |
| Top-k (Acc)k=52026.02 | 0.17 | — | — | — | — | |
| Top-k (Acc)k=72026.02 | 0.17 | — | — | — | — | |
| Term 1 (Rel)k=72026.02 | 0.17 | — | — | — | — | |
| Greedy MIk=82026.02 | 0.17 | — | — | — | — | |
| Top-k (Acc)k=12026.02 | 0.171 | — | — | — | — | |
| Term 1 (Rel)k=12026.02 | 0.171 | — | — | — | — | |
| Terms 1+2 (mRMR)k=12026.02 | 0.171 | — | — | — | — | |
| Greedy MIk=12026.02 | 0.171 | — | — | — | — | |
| Terms 1+2 (mRMR)k=22026.02 | 0.171 | — | — | — | — | |
| Greedy MIk=22026.02 | 0.171 | — | — | — | — | |
| Terms 1+2 (mRMR)k=32026.02 | 0.171 | — | — | — | — | |
| Terms 1+2 (mRMR)k=42026.02 | 0.171 | — | — | — | — | |
| Top-k (Acc)k=62026.02 | 0.171 | — | — | — | — | |
| Term 1 (Rel)k=62026.02 | 0.171 | — | — | — | — | |
| Top-k (Acc)k=22026.02 | 0.172 | — | — | — | — | |
| Term 1 (Rel)k=22026.02 | 0.172 | — | — | — | — | |
| Term 1 (Rel)k=52026.02 | 0.172 | — | — | — | — | |
| Top-k (Acc)k=82026.02 | 0.172 | — | — | — | — | |
| Term 1 (Rel)k=82026.02 | 0.172 | — | — | — | — | |
| Top-k (Acc)k=42026.02 | 0.173 | — | — | — | — | |
| Term 1 (Rel)k=42026.02 | 0.173 | — | — | — | — | |
| Terms 1+2 (mRMR)k=52026.02 | 0.173 | — | — | — | — | |
| Term 1 (Rel)k=92026.02 | 0.173 | — | — | — | — | |
| Top-k (Acc)k=32026.02 | 0.174 | — | — | — | — | |
| Term 1 (Rel)k=32026.02 | 0.174 | — | — | — | — | |
| Terms 1+2 (mRMR)k=62026.02 | 0.174 | — | — | — | — | |
| Top-k (Acc)k=92026.02 | 0.174 | — | — | — | — | |
| Greedy MIk=92026.02 | 0.174 | — | — | — | — | |
| Terms 1+2 (mRMR)k=72026.02 | 0.175 | — | — | — | — | |
| Terms 1+2 (mRMR)k=82026.02 | 0.176 | — | — | — | — | |
| Terms 1+2 (mRMR)k=92026.02 | 0.177 | — | — | — | — | |
| Top-k (Acc)k=102026.02 | 0.177 | — | — | — | — | |
| Term 1 (Rel)k=102026.02 | 0.177 | — | — | — | — | |
| Terms 1+2 (mRMR)k=102026.02 | 0.177 | — | — | — | — | |
| Greedy MIk=102026.02 | 0.181 | — | — | — | — | |
| Top-k (Acc)k=112026.02 | 0.182 | — | — | — | — | |
| Term 1 (Rel)k=112026.02 | 0.182 | — | — | — | — | |
| Greedy MIk=112026.02 | 0.183 | — | — | — | — | |
| Terms 1+2 (mRMR)k=112026.02 | 0.184 | — | — | — | — | |
| Top-k (Acc)k=122026.02 | 0.188 | — | — | — | — | |
| Term 1 (Rel)k=122026.02 | 0.188 | — | — | — | — | |
| Terms 1+2 (mRMR)k=122026.02 | 0.188 | — | — | — | — | |
| Greedy MIk=122026.02 | 0.188 | — | — | — | — | |
| CoG2026.02 | — | 27.55 | — | — | — | |
| CriSPOLLM=Claude Instant, shot_count=0-shot2024.10 | — | 52.3 | — | — | — | |
| CriSPOLLM=Claude Instant, shot_count=5-shot2024.10 | — | 54.4 | — | — | — | |
| CriSPOLLM=Claude Sonnet, shot_count=0-shot2024.10 | — | 57.9 | — | — | — | |
| CriSPOLLM=Claude Sonnet, shot_count=5-shot2024.10 | — | 57.4 | — | — | — | |
| FoSS2026.02 | — | 27.44 | — | — | — | |
| FullBackbone=Llama-3.1-8B, Training Data Percentage=100%, Data Selection Strategy=All data2026.04 | — | 40.53 | — | — | — | |
| FullBackbone=Mistral-7B-v0.3, Training Data Percentage=100%, Data Selection Strategy=All data2026.04 | — | 36.55 | — | — | — | |
| Kl-ModernBERT2026.06 | — | — | 36.7 | — | — | |
| Kl-Nb-BERT2026.06 | — | — | 39.17 | — | — | |
| Kl-NorBERT32026.06 | — | — | 34.15 | — | — | |
| Llama-3-Med42-8BData Format=Plaintext2026.06 | — | 76.51 | 76.52 | 76.57 | 76.51 | |
| Llama-3.1-8BData Format=Plaintext2026.06 | — | 70.22 | 70.2 | 70.26 | 70.22 | |
| Llama-3.1-Aloe-Beta-8BData Format=Plaintext2026.06 | — | 75.87 | 75.89 | 75.94 | 75.87 | |
| ManualLLM=Claude Instant, shot_count=0-shot2024.10 | — | 49.2 | — | — | — | |
| ManualLLM=Claude Instant, shot_count=5-shot2024.10 | — | 53.8 | — | — | — | |
| ManualLLM=Claude Sonnet, shot_count=0-shot2024.10 | — | 49.8 | — | — | — | |
| ManualLLM=Claude Sonnet, shot_count=5-shot2024.10 | — | 54.4 | — | — | — | |
| Mistral-7B-Instruct-v0.3Data Format=Plaintext2026.06 | — | 63.59 | 63.5 | 63.56 | 63.59 | |
| ModernBERT2026.06 | — | — | 31.55 | — | — | |
| Nb-BERT-large2026.06 | — | — | 28.44 | — | — | |
| NorBERT3-large2026.06 | — | — | 32.51 | — | — | |
| OPROLLM=Claude Instant2024.10 | — | 50.5 | — | — | — | |
| OPROLLM=Claude Sonnet2024.10 | — | 57.7 | — | — | — | |
| Qwen-2.5-7BData Format=Plaintext2026.06 | — | 71.93 | 71.94 | 72.08 | 71.93 | |
| RandomBackbone=Llama-3.1-8B, Training Data Percentage=30%, Data Selection Strategy=Random sampling2026.04 | — | 32.32 | — | — | — | |
| RandomBackbone=Mistral-7B-v0.3, Training Data Percentage=30%, Data Selection Strategy=Random sampling2026.04 | — | 33.11 | — | — | — | |
| Transformer (w FT)fine-tuned=true, fine-tuning dataset=WikiText-1032026.02 | — | 26.95 | — | — | — | |
| Transformer (w/o FT)fine-tuned=false2026.02 | — | 26.7 | — | — | — | |
| wICIBackbone=Llama-3.1-8B, Training Data Percentage=30%, Data Selection Strategy=In-Context Influence2026.04 | — | 39.63 | — | — | — | |
| wICIBackbone=Mistral-7B-v0.3, Training Data Percentage=30%, Data Selection Strategy=In-Context Influence2026.04 | — | 37.05 | — | — | — |