Object Color Prediction on Memory Color (zero-shot)
74.5Accuracy (zero-shot)LaMI
Evaluation Results
| Method | Links | |
|---|---|---|
| LaMILLM Category=Masked Language Models, Image Augmentation Strategy=Generation2024.06 | 74.5 | |
| LaMILLM Category=Causal Language Models, Image Augmentation Strategy=Generation2024.06 | 72.5 | |
| X-adapterLLM Category=Masked Language Models, Image Augmentation Strategy=Retrieval2024.06 | 64.1 | |
| VaLMLLM Category=Causal Language Models, Image Augmentation Strategy=Retrieval, k=82024.06 | 58.6 | |
| VaLMLLM Category=Causal Language Models, Image Augmentation Strategy=Retrieval, k=42024.06 | 54 | |
| Z-LaVILLM Category=Causal Language Models, Image Augmentation Strategy=Retrieval2024.06 | 50.4 | |
| LIVELLM Category=Causal Language Models, Image Augmentation Strategy=Generation2024.06 | 49.6 | |
| BERT (FT)LLM Category=Masked Language Models, Evaluation Protocol=Fine-tuned2024.06 | 33.9 | |
| GPT-2 (FT)LLM Category=Causal Language Models, Evaluation Protocol=Fine-tuned2024.06 | 33.3 | |
| GPT-2LLM Category=Causal Language Models, Evaluation Protocol=Zero-shot2024.06 | 32.4 | |
| BERTLLM Category=Masked Language Models, Evaluation Protocol=Zero-shot2024.06 | 31.6 | |
| VokenizationLLM Category=Masked Language Models, Image Augmentation Strategy=Retrieval2024.06 | 14.2 |