Pairwise Ranking Accuracy on Pascal-50S 5-references (test)
70HCPolos
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Polosnumber of references=5, zero-shot=true2024.02 | 70 | 99.6 | 97.4 | 79 | 86.5 | |
| RefPAC-Snumber of references=5, zero-shot=true2024.02 | 67.7 | 99.6 | 96 | 75.6 | 84.7 | |
| MIDnumber of references=5, zero-shot=true2024.02 | 67 | 99.7 | 97.4 | 76.8 | 85.2 | |
| UMICnumber of references=5, zero-shot=true2024.02 | 66.1 | 99.8 | 98.1 | 76.2 | 85.1 | |
| BERTScorenumber of references=5, zero-shot=true2024.02 | 65.4 | 98.1 | 96.4 | 60.3 | 80.1 | |
| CIDErnumber of references=5, zero-shot=true2024.02 | 65.1 | 98.1 | 90.5 | 64.8 | 79.6 | |
| MoverScorenumber of references=5, zero-shot=true2024.02 | 65.1 | 97.1 | 93.2 | 65.6 | 80.3 | |
| RefCLIP-Snumber of references=5, zero-shot=true2024.02 | 64.5 | 99.6 | 95.4 | 72.8 | 83.1 | |
| METEORnumber of references=5, zero-shot=true2024.02 | 63.8 | 97.7 | 93.7 | 65.4 | 80.2 | |
| ROUGEnumber of references=5, zero-shot=true2024.02 | 63.7 | 95.3 | 92.3 | 61.2 | 78.1 | |
| SPICEnumber of references=5, zero-shot=true2024.02 | 63.6 | 96.3 | 86.7 | 68.3 | 78.7 | |
| PAC-Snumber of references=5, zero-shot=true2024.02 | 60.6 | 99.3 | 96.9 | 72.9 | 82.4 | |
| BLEUnumber of references=5, zero-shot=true2024.02 | 60.4 | 90.6 | 84.9 | 54.7 | 72.7 | |
| CLIP-Snumber of references=5, zero-shot=true2024.02 | 56.5 | 99.3 | 96.4 | 70.4 | 80.7 | |
| TIGErnumber of references=5, zero-shot=true2024.02 | 56 | 99.8 | 92.8 | 74.2 | 80.7 | |
| ViLBERTScorenumber of references=5, zero-shot=true2024.02 | 49.9 | 99.6 | 93.1 | 75.8 | 79.6 |