Sarcasm Explanation Generation on WITS (test)
44.7ROUGE-1MuVaC
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| MuVaC2026.01 | 44.7 | 22.1 | 42.4 | 41.1 | 26.1 | 17.9 | 13.2 | 39.4 | 79.3 | |
| EDGE2026.01 | 44.4 | 21.8 | 42.4 | 37.6 | 23.2 | 16.6 | 12.9 | 39.9 | 80.2 | |
| CCG-Net2026.01 | 42.8 | 21.7 | 39.7 | 35.1 | 22.6 | 16.2 | 11.3 | 33.5 | 77.3 | |
| MOSES2026.01 | 42.2 | 20.4 | 39.7 | 34.9 | 21.5 | 15.5 | 11.5 | 32.4 | 77.8 | |
| MAF2026.01 | 39.7 | 17.1 | 37.4 | 33.2 | 18.7 | 12.4 | 8.6 | 30.4 | 77.7 | |
| MAF-TAVBMode=Multimodality, Backbone=BART, Modality=Text + Audio + Visual2022.03 | 39.69 | 17.1 | 37.37 | 33.2 | 18.69 | 12.37 | 8.58 | 30.4 | 77.67 | |
| MAF-TVMMode=Multimodality, Backbone=mBART, Modality=Text + Visual2022.03 | 39.47 | 16.78 | 37.38 | 32.44 | 17.91 | 12.02 | 7.36 | 29.74 | 77.47 | |
| MAF-TAMMode=Multimodality, Backbone=mBART, Modality=Text + Audio2022.03 | 39.02 | 15.9 | 36.83 | 31.26 | 16.94 | 11.54 | 7.72 | 29.05 | 77.06 | |
| MAF-TAVMMode=Multimodality, Backbone=mBART, Modality=Text + Audio + Visual2022.03 | 38.52 | 14.13 | 36.6 | 30.5 | 15.2 | 9.78 | 5.74 | 27.42 | 76.7 | |
| MAF-TABMode=Multimodality, Backbone=BART, Modality=Text + Audio2022.03 | 38.21 | 14.53 | 35.97 | 30.58 | 15.36 | 9.63 | 5.96 | 27.71 | 77.08 | |
| MAF-TVBMode=Multimodality, Backbone=BART, Modality=Text + Visual2022.03 | 37.48 | 15.38 | 35.64 | 30.28 | 16.89 | 10.33 | 6.55 | 28.24 | 76.95 | |
| BART2026.01 | 36.9 | 11.9 | 33.5 | 27.4 | 12.2 | 6 | 2.9 | 26.9 | 73.8 | |
| BARTMode=Multimodality2022.03 | 36.88 | 11.91 | 33.49 | 27.44 | 12.23 | 5.96 | 2.89 | 26.65 | 76.03 | |
| mBART2026.01 | 33.7 | 11 | 31.5 | 22.9 | 10.6 | 6.1 | 3.4 | 21 | 76 | |
| mBARTMode=Multimodality2022.03 | 33.66 | 11.02 | 31.5 | 22.92 | 10.56 | 6.07 | 3.39 | 21.03 | 73.83 | |
| RNNMode=Textual2022.03 | 29.22 | 7.85 | 27.59 | 22.06 | 8.22 | 4.76 | 2.88 | 18.45 | 73.24 | |
| RNN2026.01 | 29.2 | 7.9 | 27.6 | 22.1 | 8.2 | 4.8 | 2.9 | 18.5 | 73.2 | |
| TransformersMode=Textual2022.03 | 29.17 | 6.35 | 27.97 | 17.79 | 5.63 | 2.61 | 0.88 | 15.65 | 72.21 | |
| PGNMode=Textual2022.03 | 23.37 | 4.83 | 17.46 | 17.32 | 6.68 | 1.58 | 0.52 | 23.54 | 71.9 |