Image Captioning on MS-COCO (Few-Shot Performance)
80.02Score (Shot 1)Lever-LM
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Lever-LMBackbone=Open-Flamingo2023.12 | 80.02 | 88.63 | 84.32 | 93.41 | 96.06 | 97.26 | 99.35 | 96.52 | 92.45 | |
| Lever-LMBackbone=IDEFICS2023.12 | 78.7 | 100.45 | 89.57 | 104.52 | 104.86 | 106.44 | 107.33 | 105.79 | 100.38 | |
| RSBackbone=IDEFICS2023.12 | 76.44 | 96.31 | 86.37 | 100.8 | 101.82 | 103.64 | 105.18 | 102.86 | 97.36 | |
| RSBackbone=Open-Flamingo2023.12 | 73.32 | 82.95 | 78.14 | 87.72 | 93.65 | 95.81 | 97.42 | 93.65 | 88.48 | |
| SIIRBackbone=Open-Flamingo2023.12 | 71.71 | 84.87 | 78.29 | 90.83 | 93.22 | 97.8 | 101.01 | 95.72 | 89.91 | |
| SIIRBackbone=IDEFICS2023.12 | 66.61 | 83.31 | 74.96 | 89.43 | 93.02 | 97.07 | 99.7 | 94.81 | 88.19 | |
| SITRBackbone=Open-Flamingo2023.12 | 66.05 | 77.69 | 71.87 | 83.46 | 85.05 | 89.84 | 93.57 | 87.98 | 82.61 | |
| SITRBackbone=IDEFICS2023.12 | 62.08 | 75.5 | 68.79 | 82.57 | 86.64 | 90.34 | 92.88 | 88.11 | 81.67 |