Object Color Prediction on Color Terms zero-shot
72.5AccuracyLaMI
Evaluation Results
| Method | Links | |
|---|---|---|
| LaMILLM Category=Masked Language Models, Image Augmentation Strategy=Generation2024.06 | 72.5 | |
| LaMILLM Category=Causal Language Models, Image Augmentation Strategy=Generation2024.06 | 69.2 | |
| X-adapterLLM Category=Masked Language Models, Image Augmentation Strategy=Retrieval2024.06 | 60 | |
| VaLMLLM Category=Causal Language Models, Image Augmentation Strategy=Retrieval, k=42024.06 | 52.7 | |
| VaLMLLM Category=Causal Language Models, Image Augmentation Strategy=Retrieval, k=82024.06 | 50.2 | |
| Z-LaVILLM Category=Causal Language Models, Image Augmentation Strategy=Retrieval2024.06 | 49.2 | |
| LIVELLM Category=Causal Language Models, Image Augmentation Strategy=Generation2024.06 | 46.7 | |
| GPT-2 (FT)LLM Category=Causal Language Models, Evaluation Protocol=Fine-tuned2024.06 | 34.9 | |
| GPT-2LLM Category=Causal Language Models, Evaluation Protocol=Zero-shot2024.06 | 34.6 | |
| BERT (FT)LLM Category=Masked Language Models, Evaluation Protocol=Fine-tuned2024.06 | 31.5 | |
| BERTLLM Category=Masked Language Models, Evaluation Protocol=Zero-shot2024.06 | 30.7 | |
| VokenizationLLM Category=Masked Language Models, Image Augmentation Strategy=Retrieval2024.06 | 20 |