Robotic Manipulation on CALVIN D→D
4.52Average LengthMDT-V
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| MDT-VBit-width=FP16, Model Size=45.04 MB2026.04 | 4.52 | — | — | — | — | — | — | — | |
| DC-QFABit-width=W8A8, Model Size=22.52 MB2026.04 | 4.48 | — | — | — | — | — | — | — | |
| DC-QFABit-width=FP8, Model Size=22.52 MB2026.04 | 4.47 | — | — | — | — | — | — | — | |
| MDT-V w/ BatchQuantBit-width=FP8, Model Size=22.52 MB2026.04 | 4.45 | — | — | — | — | — | — | — | |
| DC-QFABit-width=W4A4, Model Size=11.26 MB2026.04 | 4.45 | — | — | — | — | — | — | — | |
| MDT-V w/ SQILBit-width=W8A8, Model Size=22.52 MB2026.04 | 4.43 | — | — | — | — | — | — | — | |
| MDT-V w/ BatchQuantBit-width=W8A8, Model Size=22.52 MB2026.04 | 4.42 | — | — | — | — | — | — | — | |
| MDT-V w/ SQILBit-width=W4A4, Model Size=11.26 MB2026.04 | 4.39 | — | — | — | — | — | — | — | |
| MDT-V w/ BatchQuantBit-width=W4A4, Model Size=11.26 MB2026.04 | 4.33 | — | — | — | — | — | — | — | |
| HD-ExpItIteration=32026.03 | 4.28 | 97.5 | 92.7 | 86.6 | 79.3 | 71.3 | — | — | |
| MDT-V w/ SmoothQuantBit-width=W8A8, Model Size=22.52 MB2026.04 | 4.23 | — | — | — | — | — | — | — | |
| MDT-V w/ AWQBit-width=W4A4, Model Size=11.26 MB2026.04 | 4.22 | — | — | — | — | — | — | — | |
| MDT-V w/ AWQBit-width=W8A8, Model Size=22.52 MB2026.04 | 4.21 | — | — | — | — | — | — | — | |
| MDT-V w/ SmoothQuantBit-width=W4A4, Model Size=11.26 MB2026.04 | 4.19 | — | — | — | — | — | — | — | |
| 3D Foresighttraining=pre-trained2025.02 | 4.08 | 95.7 | 88 | 81.6 | 74.9 | 66.3 | — | — | |
| HD-ExpItIteration=22026.03 | 4.05 | 95.1 | 88.9 | 82 | 74.2 | 64.1 | — | — | |
| 3D Foresighttraining=scratch2025.02 | 4.01 | 95.5 | 87.6 | 80.9 | 73.2 | 64.1 | — | — | |
| 2D Foresighttraining=scratch2025.02 | 3.9 | 94.8 | 85.1 | 76.6 | 70.8 | 62.5 | — | — | |
| RoboUniView2025.02 | 3.85 | 96.2 | 88.8 | 77.6 | 66.6 | 56.3 | — | — | |
| GR-MG2025.02 | 3.84 | 93 | 84.5 | 76.5 | 69 | 60.8 | — | — | |
| HD-ExpIt-ftIteration=32026.03 | 3.8 | 93.2 | 85.4 | 76.6 | 66.9 | 57.3 | — | — | |
| HD-ExpIt-ftIteration=22026.03 | 3.76 | 93.2 | 85.1 | 76.2 | 66.1 | 55.9 | — | — | |
| MDT2026.03 | 3.72 | 93.7 | 84.5 | 74.1 | 64.4 | 55.6 | — | — | |
| HD-ExpItIteration=12026.03 | 3.64 | 91.5 | 81.5 | 73.3 | 63.6 | 54 | — | — | |
| DTPExperiment=D→D2025.02 | 3.55 | 92.4 | 81.9 | 70.2 | 60.3 | 50.9 | — | — | |
| HD-ExpIt-ftIteration=12026.03 | 3.52 | 91.2 | 79.9 | 69.8 | 59.9 | 50.7 | — | — | |
| HULC++Experiment=D→D2025.02 | 3.3 | 93 | 79 | 64 | 52 | 40 | — | — | |
| TaKSIE2026.03 | 3.18 | 90.4 | 73.9 | 61.7 | 51.2 | 40.8 | — | — | |
| MT-ACTExperiment=D→D2025.02 | 3.03 | 88.4 | 72.2 | 57.2 | 44.9 | 35.3 | — | — | |
| HD-ACT-ExpIt-ftIteration=22026.03 | 2.94 | 88.6 | 72.6 | 57 | 43.7 | 32.7 | — | — | |
| HD-ACT-ExpIt-ftIteration=32026.03 | 2.9 | 87 | 71.2 | 56.2 | 43.6 | 31.8 | — | — | |
| LDC2026.03 | 2.88 | 88.7 | 69.9 | 54.5 | 42.7 | 32.2 | — | — | |
| SuSIE2026.03 | 2.8 | 87.7 | 67.4 | 49.8 | 41.9 | 33.7 | — | — | |
| HDIteration=02026.03 | 2.69 | 83.9 | 65.2 | 51.4 | 39.5 | 29.2 | — | — | |
| HD-ACT-ExpIt-ftIteration=12026.03 | 2.67 | 85.3 | 66 | 50.8 | 37.8 | 27 | — | — | |
| GR-1Experiment=D→D2025.02 | 2.65 | 82.2 | 65.3 | 49.1 | 38.6 | 29.4 | — | — | |
| HULCExperiment=D→D2025.02 | 2.64 | 82.7 | 64.9 | 50.4 | 38.5 | 28.3 | — | — | |
| HULC2026.03 | 2.64 | 82.7 | 64.9 | 50.4 | 38.5 | 28.3 | — | — | |
| HD-ExpIt-ftIteration=1, Training Variant=reset only2026.03 | 2.5 | 88.5 | 68.8 | 47.7 | 29.3 | 15.1 | — | — | |
| HD-ACTIteration=02026.03 | 1.89 | 76 | 49.3 | 31.4 | 19.9 | 12.3 | — | — | |
| BB-Coordinates + Cropped-ImgFeature Input=Fully-Connected Graphs2026.06 | — | — | — | — | — | — | — | 1.2 | |
| Cropped-ImgFeature Input=Fully-Connected Graphs2026.06 | — | — | — | — | — | — | — | 1.3 | |
| DeeR2025.12 | — | 85.3 | 69.6 | 54.9 | 42 | 31.2 | 2.83 | — | |
| HiMoE-VLA2025.12 | — | 93.2 | 85.5 | 78.9 | 73.1 | 66 | 3.967 | — | |
| ImageFeature Input=Baseline2026.06 | — | — | — | — | — | — | — | 1.5 | |
| MDT2025.12 | — | 93.7 | 84.5 | 74.1 | 64.4 | 55.6 | 3.723 | — | |
| Octo2025.12 | — | 77.1 | 53.5 | 31.8 | 20.6 | 13.6 | 1.968 | — | |
| OpenVLA2025.12 | — | 71.6 | 38.5 | 18 | 8.8 | 4.2 | 1.411 | — | |
| RDT-1BParameters=1B2025.12 | — | 75.7 | 49.5 | 35.9 | 24.3 | 18.4 | 2.038 | — | |
| TopKFeature Input=Sparse Graph Methods2026.06 | — | — | — | — | — | — | — | 1.4 | |
| π02025.12 | — | 91.4 | 83 | 73.9 | 67.6 | 59.9 | 3.758 | — |