Figure Captioning on SciCap Caption w/ <=100 words
16.16BLEUChaTS-Pi (MATCHA-DePLot+FLAN-T5)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ChaTS-Pi (MATCHA-DePLot+FLAN-T5)Input=image2024.05 | 16.16 | 0.46 | 0.3 | 0.48 | |
| MATCHA-DePLot+FLAN-T5Input=DePLot-table2024.05 | 15.9 | 0.34 | 0.29 | 0.48 | |
| DePLot+FLAN-T5Input=image2024.05 | 15.71 | 0.35 | 0.29 | 0.17 | |
| ChaTS-Pi (DePLot+FLAN-T5)Input=DePLot table2024.05 | 15.51 | 0.48 | 0.3 | 0.17 | |
| DePLot+T5Input=image2024.05 | 14.52 | 0.31 | 0.28 | 0.15 | |
| ChaTS-Pi (DePLot+T5)Input=DePLot table2024.05 | 14.2 | 0.45 | 0.29 | 0.15 | |
| CNN+LSTM(Text only)Input=Text2024.05 | 1.72 | — | — | — | |
| PALM-2Input=image2024.05 | 0.81 | 0.82 | 0.3 | 0.41 | |
| ChaTS-Pi (PALM-2)Input=DePLot table2024.05 | 0.64 | 0.93 | 0.32 | 0.46 |