Figure Captioning on SciCap Single-Sent Caption
18BLEUChaTS-Pi (DePLot+FLAN-T5)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ChaTS-Pi (DePLot+FLAN-T5)Input=DePLot table2024.05 | 18 | 0.53 | 0.32 | 0.35 | |
| ChaTS-Pi (MATCHA-DePLot+FLAN-T5)Input=image2024.05 | 16.96 | 0.51 | 0.32 | 0.23 | |
| ChaTS-Pi (DePLot+T5)Input=DePLot table2024.05 | 15.72 | 0.52 | 0.3 | 0 | |
| MATCHA-DePLot+FLAN-T5Input=DePLot-table2024.05 | 15.33 | 0.37 | 0.3 | 0.23 | |
| DePLot+FLAN-T5Input=image2024.05 | 15.28 | 0.38 | 0.3 | 0.37 | |
| DePLot+T5Input=image2024.05 | 13.27 | 0.34 | 0.28 | 0 | |
| CNN+LSTM(Text only)Input=Text2024.05 | 2.12 | — | — | — | |
| PALM-2Input=image2024.05 | 0.69 | 0.84 | 0.31 | 0.35 | |
| ChaTS-Pi (PALM-2)Input=DePLot table2024.05 | 0.61 | 0.93 | 0.32 | 0.42 |