Video-to-audio captioning on VGGSound (test)
90.9BertScore F1VATT Converter
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VATT ConverterBackbone LLM=LLama2024.11 | 90.9 | 42.4 | 38.4 | 1.354 | 0.263 | |
| VATT-QformerBackbone LLM=LLama2024.11 | 90.7 | 41.9 | 37.5 | 1.264 | 0.245 | |
| VATT ConverterBackbone LLM=Gemma2024.11 | 90 | 34.5 | 33.7 | 0.926 | 0.229 | |
| LLAVAPrompt type=Audio Prompt2024.11 | 87 | 12.3 | 15.5 | 0.095 | 0.182 | |
| Video-LLAMAPrompt type=Audio Prompt2024.11 | 86.1 | 9.1 | 11.7 | 0.021 | 0.204 | |
| LLAVAPrompt type=Visual Prompt2024.11 | 85.5 | 8.9 | 13.7 | 0.026 | 0.213 |