Optical Flow on MPI Sintel (train)
0.74EPE (Final)FlowFormer
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FlowFormerLearning Paradigm=Supervised, Parameters=18.2M, Evaluation data used in training=true2024.05 | 0.74 | 0.48 | |
| RAFT-ftLearning Setting=Supervised, Training Data=S/K, Fine-tuned=true2022.11 | 1.2 | 0.77 | |
| RAFTLearning Paradigm=Supervised, Parameters=5.3M, Evaluation data used in training=true2024.05 | 1.27 | 0.77 | |
| FlowNet2-ftLearning Setting=Supervised, Training Data=S/K, Fine-tuned=true2022.11 | 2.01 | 1.45 | |
| PWC-Net-ftLearning Setting=Supervised, Training Data=S/K, Fine-tuned=true2022.11 | 2.21 | 1.7 | |
| PWC-Net+Learning Paradigm=Supervised, Parameters=8.8M, Evaluation data used in training=true2024.05 | 2.34 | 1.71 | |
| CamLiRAFTTraining Data=T, Input=RGB + XYZ2023.03 | 2.38 | 1.27 | |
| IRR-PWCLearning Paradigm=Supervised, Parameters=6.4M, Evaluation data used in training=true2024.05 | 2.51 | 1.92 | |
| CamLiPWCTraining Data=T, Input=RGB + XYZ2023.03 | 2.55 | 1.79 | |
| S-Flow2024.01 | 2.59 | 1.3 | |
| Ef-RAFTFine-tuned=false2024.01 | 2.6 | 1.27 | |
| UPFlowLearning Setting=Unsupervised, Training Data=S/Kraw2022.11 | 2.67 | 2.33 | |
| EMD-S2024.01 | 2.67 | 1.31 | |
| UPFlowLearning Paradigm=Unsupervised, Parameters=3.5M, Evaluation data used in training=true2024.05 | 2.67 | 2.33 | |
| KPA-Flow2024.01 | 2.68 | 1.28 | |
| AGFlow2024.01 | 2.69 | 1.31 | |
| FastFlowNet-ftLearning Setting=Supervised, Training Data=S/K, Fine-tuned=true2022.11 | 2.71 | 2.08 | |
| RAFTLearning Setting=Supervised, Training Data=C+T2022.11 | 2.71 | 1.43 | |
| RAFT2024.01 | 2.71 | 1.43 | |
| GMFlowNet2024.01 | 2.71 | 1.14 | |
| RAFTTraining Data=C + T, Input=RGB2023.03 | 2.71 | 1.43 | |
| GMA2024.01 | 2.74 | 1.3 | |
| CRAFT2024.01 | 2.79 | 1.27 | |
| ASFlowLearning Setting=Unsupervised, Training Data=S/Kraw2022.11 | 2.89 | 2.4 | |
| RAFT-3DTraining Data=T, Input=RGB + Depth2023.03 | 2.91 | 1.75 | |
| FM-RAFT2024.01 | 2.95 | 1.29 | |
| UnSAMFlow (+aug +hg +mf)Learning Paradigm=Unsupervised, Parameters=2.6M, Evaluation data used in training=true, semantic augmentation module=true, homography smoothness loss=true, mask feature module=true, SAM used in training=true, SAM used in inference=true2024.05 | 3.07 | 2.21 | |
| UnSAMFlow (+aug +hg)Learning Paradigm=Unsupervised, Parameters=2.5M, Evaluation data used in training=true, semantic augmentation module=true, homography smoothness loss=true, SAM used in training=true2024.05 | 3.1 | 2.25 | |
| FlowNet2Learning Setting=Supervised, Training Data=C+T2022.11 | 3.14 | 2.02 | |
| MDFlowLearning Setting=Unsupervised, Training Data=C + S/K2022.11 | 3.14 | 2.17 | |
| Flow1D2024.01 | 3.27 | 1.98 | |
| UnSAMFlow (+aug)Learning Paradigm=Unsupervised, Parameters=2.5M, Evaluation data used in training=true, semantic augmentation module=true, SAM used in training=true2024.05 | 3.33 | 2.35 | |
| OIFlowLearning Setting=Unsupervised, Training Data=C + S/K2022.11 | 3.35 | 2.44 | |
| UFlowLearning Setting=Unsupervised, Training Data=C + S/K2022.11 | 3.39 | 2.5 | |
| UFlowLearning Paradigm=Unsupervised, Evaluation data used in training=true2024.05 | 3.39 | 2.5 | |
| MDFlow-FastLearning Setting=Unsupervised, Training Data=C + S/K2022.11 | 3.47 | 2.53 | |
| FlowNet22024.01 | 3.54 | 2.02 | |
| FlowNet2Training Data=C + T, Input=RGB2023.03 | 3.54 | 2.02 | |
| SimFlowLearning Setting=Unsupervised, Training Data=C + S/K2022.11 | 3.57 | 2.86 | |
| SimFlowLearning Paradigm=Unsupervised, Evaluation data used in training=true2024.05 | 3.57 | 2.86 | |
| STFlowLearning Setting=Unsupervised, Training Data=C + S/K2022.11 | 3.59 | 2.91 | |
| MaskFlowNet2024.01 | 3.61 | 2.25 | |
| UnSAMFlow (baseline)Learning Paradigm=Unsupervised, Parameters=2.5M, Evaluation data used in training=true2024.05 | 3.63 | 2.67 | |
| VCN2024.01 | 3.68 | 2.21 | |
| DistillFlowLearning Setting=Unsupervised, Training Data=S + Sraw/Kraw2022.11 | 3.7 | 2.61 | |
| ARFlowLearning Setting=Unsupervised, Training Data=Sraw/Kraw2022.11 | 3.73 | 2.79 | |
| ARFlowLearning Paradigm=Unsupervised, Parameters=2.2M, Evaluation data used in training=true2024.05 | 3.73 | 2.79 | |
| DICL2024.01 | 3.77 | 1.94 | |
| LiteFlowNet22024.01 | 3.78 | 2.24 | |
| SelFlowLearning Setting=Unsupervised, Training Data=Sraw/K2022.11 | 3.87 | 2.88 | |
| SelFlowLearning Paradigm=Unsupervised, Parameters=4.8M, Evaluation data used in training=true2024.05 | 3.87 | 2.88 | |
| PWC-NetLearning Setting=Supervised, Training Data=C+T2022.11 | 3.93 | 2.55 | |
| PWC-Net2024.01 | 3.93 | 2.55 | |
| PWC-NetTraining Data=C + T, Input=RGB2023.03 | 3.93 | 2.55 | |
| DDFlowLearning Setting=Unsupervised, Training Data=C + S/K2022.11 | 3.98 | 2.92 | |
| DDFlowLearning Paradigm=Unsupervised, Parameters=4.3M, Evaluation data used in training=true2024.05 | 3.98 | 2.92 | |
| LiteFlowNet2024.01 | 4.04 | 2.48 | |
| FastFlowNetLearning Setting=Supervised, Training Data=C+T2022.11 | 4.14 | 2.89 | |
| EPIFlowLearning Setting=Unsupervised, Training Data=C + S/K2022.11 | 4.99 | 3.54 | |
| MFOccFlowLearning Setting=Unsupervised, Training Data=R + S/K2022.11 | 5.52 | 3.89 | |
| OccAwareFlowLearning Setting=Unsupervised, Training Data=C + S/K2022.11 | 5.95 | 4.03 | |
| UnFlow-CSSLearning Setting=Unsupervised, Training Data=SY/Kraw2022.11 | 7.91 | — | |
| UnFlow-CSSLearning Paradigm=Unsupervised, Parameters=116.6M2024.05 | 7.91 | — |