Procedure Planning on CrossTask
40.45Success Rate (SR)MTID
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MTIDHorizon=T = 3, Params (M)=1085.202026.03 | 40.45 | 67.19 | 69.17 | |
| ViterbiPlanNetHorizon=T = 3, Params (M)=5.492026.03 | 39.75 | 67.39 | 76.92 | |
| KEPP w/ P2KG (R=1)Required Annotations: step class=true, Visual feature network=S3D, Evaluation setting=PDPP task setting, Knowledge graph parameter (R)=12024.03 | 38.12 | 6,474 | 67.15 | |
| PDPPRequired Annotations: step class=true, Required Annotations: task class=true, Visual feature network=S3D, Evaluation setting=PDPP task setting2024.03 | 37.2 | 6,467 | 66.57 | |
| KEPP w/ P2KG (R=2)Required Annotations: step class=true, Visual feature network=S3D, Evaluation setting=Conventional, Knowledge graph parameter (R)=22024.03 | 33.38 | 6,079 | 63.89 | |
| KEPP w/ P2KG (R=1)Required Annotations: step class=true, Visual feature network=S3D, Evaluation setting=Conventional, Knowledge graph parameter (R)=12024.03 | 33.34 | 6,136 | 64.14 | |
| SkipPlanRequired Annotations: step class=true, Visual feature network=S3D, Evaluation setting=Conventional2024.03 | 28.85 | 6,118 | 74.98 | |
| E3PRequired Annotations: step class=true, Required Annotations: step text=true, Required Annotations: task class=true, Visual feature network=S3D, Evaluation setting=Conventional2024.03 | 26.4 | 5,302 | 74.05 | |
| PDPPRequired Annotations: step class=true, Required Annotations: task class=true, Visual feature network=S3D, Evaluation setting=Conventional2024.03 | 26.38 | 5,562 | 59.34 | |
| MTIDHorizon=T = 4, Params (M)=1085.202026.03 | 24.76 | 60.69 | 67.67 | |
| ViterbiPlanNetHorizon=T = 4, Params (M)=5.522026.03 | 24.19 | 61.12 | 80.67 | |
| KEPP w/ P2KG (R=1)Required Annotations: step class=true, Visual feature network=S3D, Evaluation setting=PDPP task setting, Knowledge graph parameter (R)=12024.03 | 24.15 | 59.05 | 66.64 | |
| P3IVRequired Annotations: step class=true, Required Annotations: step text=true, Visual feature network=S3D, Evaluation setting=Conventional2024.03 | 23.34 | 4,996 | 73.89 | |
| KEPP w/ P2KG (R=2)Required Annotations: step class=true, Visual feature network=Precomputed, Evaluation setting=Conventional, Knowledge graph parameter (R)=22024.03 | 22.6 | 4,876 | 53.57 | |
| PDPPRequired Annotations: step class=true, Required Annotations: task class=true, Visual feature network=S3D, Evaluation setting=PDPP task setting2024.03 | 21.48 | 57.82 | 65.13 | |
| Ext-GAILRequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 21.27 | 4,946 | 61.7 | |
| KEPP w/ P2KG (R=2)Required Annotations: step class=true, Visual feature network=S3D, Evaluation setting=Conventional, Knowledge graph parameter (R)=22024.03 | 21.02 | 56.08 | 64.15 | |
| KEPP w/ P2KG (R=1)Required Annotations: step class=true, Visual feature network=S3D, Evaluation setting=Conventional, Knowledge graph parameter (R)=12024.03 | 20.38 | 55.54 | 64.03 | |
| PDPPRequired Annotations: step class=true, Required Annotations: task class=true, Visual feature network=S3D, Evaluation setting=Conventional2024.03 | 18.69 | 52.44 | 62.38 | |
| Ext-GAIL wo Aug.Required Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 18.01 | 4,386 | 57.16 | |
| E3PRequired Annotations: step class=true, Required Annotations: step text=true, Required Annotations: task class=true, Visual feature network=S3D, Evaluation setting=Conventional2024.03 | 16.49 | 48 | 70.16 | |
| Ext-GAILRequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 16.41 | 43.05 | 60.93 | |
| PlaTeRequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 16 | 3,617 | 65.91 | |
| SkipPlanRequired Annotations: step class=true, Visual feature network=S3D, Evaluation setting=Conventional2024.03 | 15.56 | 55.64 | 70.3 | |
| ViterbiPlanNetHorizon=T = 5, Params (M)=5.552026.03 | 15.37 | 57.1 | 80.53 | |
| MTIDHorizon=T = 5, Params (M)=1085.202026.03 | 15.26 | — | — | |
| PlaTeRequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 14 | 35.29 | 55.36 | |
| KEPP w/ P2KG (R=2)Required Annotations: step class=true, Visual feature network=Precomputed, Evaluation setting=Conventional, Knowledge graph parameter (R)=22024.03 | 13.9 | 45.79 | 55 | |
| P3IVRequired Annotations: step class=true, Required Annotations: step text=true, Visual feature network=S3D, Evaluation setting=Conventional2024.03 | 13.4 | 44.16 | 70.01 | |
| DDNRequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 12.18 | 3,129 | 47.48 | |
| MTIDHorizon=T = 6, Params (M)=1085.202026.03 | 10.3 | — | — | |
| ViterbiPlanNetHorizon=T = 6, Params (M)=5.572026.03 | 9.68 | 53.99 | 86.34 | |
| Retrieval-BasedRequired Annotations: step class=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 8.05 | 2,330 | 32.06 | |
| DDNRequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 5.97 | 27.1 | 48.46 | |
| Retrieval-BasedRequired Annotations: step class=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 3.95 | 22.22 | 36.97 | |
| UPNRequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 2.89 | 2,439 | 31.56 | |
| UAAARequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 2.15 | 2,021 | 30.87 | |
| WLTDORequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 1.87 | 2,164 | 31.7 | |
| UPNRequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 1.19 | 21.59 | 27.85 | |
| UAAARequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 0.98 | 19.86 | 27.09 | |
| WLTDORequired Annotations: step class=true, Required Annotations: visual states=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 0.77 | 17.92 | 26.43 | |
| RandomRequired Annotations: step class=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 0.01 | 94 | 1.66 | |
| RandomRequired Annotations: step class=true, Visual feature network=Precomputed, Evaluation setting=Conventional2024.03 | 0.01 | 0.83 | 1.66 |