Report Generation on MAGMaR (test)
18.39ROUGE-LCRAFT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CRAFT2026.05 | 18.39 | 17.09 | 65.04 | |
| InternVL-3.5-30B-A3BASR transcript access=false2026.05 | 14.97 | 9.45 | 63.82 | |
| Gemma-4-31BASR transcript access=false2026.05 | 14.26 | 9.5 | 57.69 | |
| InternVL-3.5-30B-A3BASR transcript access=true2026.05 | 11.82 | 9.64 | 64.62 | |
| Gemma-4-31BASR transcript access=true2026.05 | 11 | 12.24 | 57.99 |