Image Captioning Evaluation on Polaris
63.2Kendall's Tau-cBEiTScore-L/14
Evaluation results
| Method | Links | |
|---|---|---|
| BEiTScore-L/14Size (M)=674.69, GFLOPs=296.732026.05 | 63.2 | |
| BEiTScore-L/14 w/o Stage 1Size (M)=674.69, GFLOPs=296.732026.05 | 62.2 | |
| BEiTScore-B/32Size (M)=222.28, GFLOPs=83.852026.05 | 61.5 | |
| EXPERTSize (M)=13350.84, GFLOPs=9317.472026.05 | 60.9 | |
| BEiTScore-B/32 w/o Stage 1Size (M)=222.28, GFLOPs=83.852026.05 | 60.9 | |
| FLEURSize (M)=13350.84, GFLOPs=9317.472026.05 | 58.4 | |
| LongCLIP-S/ViT-BSize (M)=149.84, GFLOPs=26.242026.05 | 54.8 | |
| LongCLIP-S/ViT-LSize (M)=427.75, GFLOPs=98.92026.05 | 53.9 | |
| PAC-S++/ViT-LSize (M)=430.58, GFLOPs=56.262026.05 | 53.6 | |
| CLIP-S/ViT-LSize (M)=427.62, GFLOPs=84.362026.05 | 53.2 | |
| PAC-S/ViT-LSize (M)=427.62, GFLOPs=56.262026.05 | 53.1 | |
| CLIP-S/ViT-BSize (M)=151.28, GFLOPs=7.282026.05 | 52.9 | |
| PAC-S++/ViT-BSize (M)=155.42, GFLOPs=4.882026.05 | 52.4 | |
| PAC-S/ViT-BSize (M)=151.28, GFLOPs=4.882026.05 | 52.3 | |
| VQAScore (CLIP-FlanT5-XXL)Size (M)=11459.59, GFLOPs=3742.12026.05 | 51.6 | |
| SPECSSize (M)=151.49, GFLOPs=9.22026.05 | 39.7 |