Screen Summarization on screen2words (S2W) (test)
119.6S2W ScorePaliGemma-3B
Evaluation Results
| Method | Links | |
|---|---|---|
| PaliGemma-3BFine-tuning protocol=per-task fine-tuning2024.09 | 119.6 | |
| Ferret-UI-13B2024.09 | 113.4 | |
| Spotlight2024.09 | 106.7 | |
| MM1.5-UI-30B2024.09 | 106 | |
| MM1.5-UI-3BTraining epochs=1 ep.2024.09 | 103.9 | |
| MM1.5-UI-3BTraining epochs=1 ep., SFT strategy=w/o MM1.5 SFT2024.09 | 103.8 | |
| MM1.5-UI-3B2024.09 | 103.3 | |
| MM1.5-UI-1B2024.09 | 103 | |
| MM1.5-UI-7B2024.09 | 100.6 |