Robotic Control on Emergent Evaluation quantitative (test)
93Symbol 1 ScoreRT-2-PaLI-X
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RT-2-PaLI-Xsize=55B2023.07 | 93 | 60 | 93 | 82 | 25 | 52 | 48 | 58 | 46 | 53 | 53 | 53 | 60 | |
| RT-2-PaLM-Esize=12B2023.07 | 67 | 20 | 20 | 36 | 35 | 56 | 44 | 35 | 43 | 33 | 53 | 43 | 40 | |
| RT-12023.07 | 27 | 20 | 0 | 16 | 5 | 0 | 32 | 28 | 16 | 20 | 20 | 20 | 17 | |
| VC-12023.07 | 7 | 25 | 0 | 11 | 0 | 8 | 20 | 13 | 10 | 20 | 7 | 13 | 11 |