Smelt Items on MCU
77Furnace Success RateJARVIS-VLA-Qwen2
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| JARVIS-VLA-Qwen2Model Size=7B2025.03 | 77 | 70 | 70 | 72 | |
| GROOTModel Size=248M2025.03 | 35 | 25 | 30 | 30 | |
| STEVE-1Model Size=248M2025.03 | 25 | 40 | 33 | 33 | |
| MineDreamerModel Size=7B2025.03 | 20 | 20 | 20 | 20 | |
| Qwen2-VL (IL)Model Size=7B2025.03 | 17 | 37 | 29 | 28 | |
| VPT-BCModel Size=248M2025.03 | 10 | 0 | 5 | 5 | |
| VPT-RLModel Size=248M2025.03 | 5 | 35 | 20 | 20 | |
| Qwen2-VL (raw)Model Size=7B2025.03 | 3 | 10 | 7 | 7 |