Failure detection on Mobile manipulation environment
91F1 ScorePaLM-E-12B
Evaluation results
| Method | Links | |
|---|---|---|
| PaLM-E-12Btrained on=Single robot, from scratch=false, LLM+ViT pretrain=true, LLM frozen=true2023.03 | 91 | |
| PaLM-E-12Btrained on=Full mixture, from scratch=false, LLM+ViT pretrain=true, LLM frozen=true2023.03 | 91 | |
| CLIP-FT-hindsight2023.03 | 89 | |
| PaLM-E-12Btrained on=Full mixture, from scratch=false, LLM+ViT pretrain=false, LLM frozen=false2023.03 | 77 | |
| PaLIzero-shot=true2023.03 | 73 | |
| CLIP-FT2023.03 | 65 | |
| PaLM-E-12Btrained on=Single robot, from scratch=true, LLM+ViT pretrain=false, LLM frozen=n/a2023.03 | 54 |