Referring and Grounding on Ferret-UI Elementary Tasks (test)
91.8Ref-iMM1.5-UI-30B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MM1.5-UI-30B2024.09 | 91.8 | 89.7 | 88.2 | 89.1 | |
| MM1.5-UI-7B2024.09 | 91.2 | 89.2 | 87.2 | 88.6 | |
| MM1.5-UI-3B2024.09 | 90.8 | 89.2 | 87.3 | 88.8 | |
| MM1.5-UI-1B2024.09 | 90 | 88.6 | 86.5 | 88.2 | |
| MM1.5-UI-3BTraining epochs=1 ep.2024.09 | 88.6 | 87.7 | 86 | 87.9 | |
| MM1.5-UI-3BTraining epochs=1 ep., SFT strategy=w/o MM1.5 SFT2024.09 | 88.2 | 87.4 | 85.5 | 87.1 | |
| Ferret-UI-13B2024.09 | 80.5 | 82.4 | 79.4 | 83.5 |