Image Classification on MHIST (test)
94.27AccuracyRMSGD
Evaluation Results
| Method | Links | |
|---|---|---|
| RMSGDNetwork=ResNet182022.03 | 94.27 | |
| RMSGDNetwork=ResNet342022.03 | 94.19 | |
| AdamPNetwork=ResNet182022.03 | 94.04 | |
| AdamPNetwork=ResNet342022.03 | 93.95 | |
| RMSGDNetwork=MobileNetV22022.03 | 93.83 | |
| AdamPNetwork=MobileNetV22022.03 | 93.78 | |
| SGDPNetwork=ResNet342022.03 | 93.65 | |
| SGDPNetwork=ResNet182022.03 | 93.48 | |
| SGDNetwork=ResNet342022.03 | 93.38 | |
| SAMNetwork=ResNet182022.03 | 93.28 | |
| SAMNetwork=ResNet342022.03 | 93.24 | |
| SGDNetwork=ResNet182022.03 | 93.22 | |
| AdamNetwork=MobileNetV22022.03 | 92.89 | |
| AdamNetwork=ResNet342022.03 | 92.8 | |
| AdamNetwork=ResNet182022.03 | 92.75 | |
| SGDPNetwork=MobileNetV22022.03 | 91.42 | |
| SAMNetwork=MobileNetV22022.03 | 89.43 | |
| SGDNetwork=MobileNetV22022.03 | 88.81 | |
| MoCo v2Backbone=ResNet-50, Protocol=Fine-tune2022.12 | 85.88 | |
| SupervisedBackbone=ViT-S, Protocol=Fine-tune, Patch Size=162022.12 | 81.68 | |
| BTBackbone=ResNet-50, Protocol=Fine-tune2022.12 | 81.27 | |
| DINOBackbone=ViT-S, Protocol=Fine-tune, Patch Size=162022.12 | 79.43 | |
| SupervisedBackbone=ResNet-50, Protocol=Fine-tune2022.12 | 78.92 | |
| BTBackbone=ResNet-50, Protocol=Linear2022.12 | 78.81 | |
| SupervisedBackbone=ViT-S, Protocol=Linear, Patch Size=162022.12 | 78.51 | |
| DINOBackbone=ViT-S, Protocol=Fine-tune, Patch Size=82022.12 | 78.4 | |
| SwAVBackbone=ResNet-50, Protocol=Fine-tune2022.12 | 77.99 | |
| DINOBackbone=ViT-S, Protocol=Linear, Patch Size=82022.12 | 77.89 | |
| MoCo v2Backbone=ResNet-50, Protocol=Linear2022.12 | 77.07 | |
| SupervisedBackbone=ResNet-50, Protocol=Linear2022.12 | 76.25 | |
| DINOBackbone=ViT-S, Protocol=Linear, Patch Size=162022.12 | 76.15 | |
| RandomBackbone=ResNet-50, Protocol=Fine-tune2022.12 | 75.54 | |
| SwAVBackbone=ResNet-50, Protocol=Linear2022.12 | 71.14 | |
| Clean RAG (avg.)Model=LLaVA-Med, Retriever=Average2026.05 | 70.77 | |
| Clean RAG (avg.)Model=GPT-4o, Retriever=Average2026.05 | 70.2 | |
| Clean RAG (avg.)Model=GPT-5, Retriever=Average2026.05 | 69.21 | |
| Clean RAG (avg.)Model=Claude-4.5, Retriever=Average2026.05 | 67.57 | |
| LIARModel=LLaVA-Med, Retriever=BGE-VL2026.05 | 66.19 | |
| RandomBackbone=ViT-S, Protocol=Linear, Patch Size=162022.12 | 63.46 | |
| RandomBackbone=ResNet-50, Protocol=Linear2022.12 | 63.15 | |
| RandomBackbone=ViT-S, Protocol=Fine-tune, Patch Size=162022.12 | 62.13 | |
| LIARModel=GPT-5, Retriever=BGE-VL2026.05 | 61.61 | |
| LIARModel=GPT-5, Retriever=CLIP2026.05 | 60.71 | |
| LIARModel=Claude-4.5, Retriever=BGE-VL2026.05 | 58.97 | |
| ACE-LoRASetting=Zero-shot2026.03 | 57.27 | |
| LIARModel=LLaVA-Med, Retriever=CLIP2026.05 | 57.14 | |
| QuiltNetSetting=Zero-shot2026.03 | 56.82 | |
| PLIPSetting=Zero-shot2026.03 | 56.63 | |
| LIARModel=GPT-4o, Retriever=BGE-VL2026.05 | 55.99 | |
| M³AttModel=LLaVA-Med, Retriever=BGE-VL2026.05 | 54.76 | |
| LIARModel=GPT-4o, Retriever=CLIP2026.05 | 54.27 | |
| M³AttModel=LLaVA-Med, Retriever=CLIP2026.05 | 49.4 | |
| LIARModel=Claude-4.5, Retriever=CLIP2026.05 | 49.11 | |
| M³AttModel=GPT-5, Retriever=CLIP2026.05 | 48.87 | |
| M³AttModel=GPT-5, Retriever=BGE-VL2026.05 | 48.64 | |
| LIARModel=LLaVA-Med, Retriever=Filtered2026.05 | 44.11 | |
| BMC-CLIPSetting=Zero-shot2026.03 | 41.78 | |
| M³AttModel=Claude-4.5, Retriever=BGE-VL2026.05 | 40.84 | |
| M³AttModel=GPT-4o, Retriever=CLIP2026.05 | 39.64 | |
| M³AttModel=GPT-4o, Retriever=BGE-VL2026.05 | 39 | |
| M³AttModel=LLaVA-Med, Retriever=Filtered2026.05 | 38.57 | |
| w/o RAGModel=LLaVA-Med, Retriever=None2026.05 | 37.14 | |
| M³AttModel=Claude-4.5, Retriever=CLIP2026.05 | 36.24 | |
| LIARModel=GPT-5, Retriever=Filtered2026.05 | 34.67 | |
| BiomedCLIPSetting=Zero-shot2026.03 | 34.04 | |
| w/o RAGModel=GPT-5, Retriever=None2026.05 | 31.43 | |
| M³AttModel=GPT-5, Retriever=Filtered2026.05 | 30 | |
| LIARModel=Gemini-2.5, Retriever=CLIP2026.05 | 27.64 | |
| M³AttModel=Gemini-2.5, Retriever=CLIP2026.05 | 21.93 | |
| LIARModel=Gemini-2.5, Retriever=Filtered2026.05 | 17.06 | |
| LIARModel=Claude-4.5, Retriever=Filtered2026.05 | 16.96 | |
| LIARModel=GPT-4o, Retriever=Filtered2026.05 | 16.63 | |
| M³AttModel=GPT-4o, Retriever=Filtered2026.05 | 14.29 | |
| M³AttModel=Claude-4.5, Retriever=Filtered2026.05 | 14.29 | |
| M³AttModel=Gemini-2.5, Retriever=Filtered2026.05 | 13.57 | |
| w/o RAGModel=GPT-4o, Retriever=None2026.05 | 12.14 | |
| w/o RAGModel=Gemini-2.5, Retriever=None2026.05 | 12.14 | |
| w/o RAGModel=Claude-4.5, Retriever=None2026.05 | 12.14 | |
| Clean RAG (avg.)Model=Gemini-2.5, Retriever=Average2026.05 | 3.14 | |
| LIARModel=Gemini-2.5, Retriever=BGE-VL2026.05 | 0 | |
| M³AttModel=Gemini-2.5, Retriever=BGE-VL2026.05 | 0 |