Optical Flow Estimation on MPI Sintel (test)
1EPE (Clean, all)SAMFlow
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SAMFlowLearning Paradigm=Supervised, SAM used in training=true, SAM used in inference=true2024.05 | 1 | 0.38 | 5.97 | 2.08 | 1.04 | 10.6 | |
| FlowFormerLearning Paradigm=Supervised, Parameters=18.2M2024.05 | 1.16 | 0.42 | 7.16 | 2.09 | 0.96 | 11.3 | |
| RAFTLearning Paradigm=Supervised, Parameters=5.3M2024.05 | 1.61 | 0.62 | 9.65 | 2.86 | 1.41 | 14.68 | |
| PWC-Net+Learning Paradigm=Supervised, Parameters=8.8M2024.05 | 3.45 | 1.41 | 20.12 | 4.6 | 2.25 | 23.7 | |
| IRR-PWCLearning Paradigm=Supervised, Parameters=6.4M2024.05 | 3.84 | 1.47 | 23.22 | 4.58 | 2.15 | 24.36 | |
| UnSAMFlow (+aug +hg +mf)Learning Paradigm=Unsupervised, Parameters=2.6M, semantic augmentation module=true, homography smoothness loss=true, mask feature module=true, SAM used in training=true, SAM used in inference=true2024.05 | 3.93 | 1.67 | 22.34 | 5.2 | 2.56 | 26.75 | |
| UnSAMFlow (+aug)Learning Paradigm=Unsupervised, Parameters=2.5M, semantic augmentation module=true, SAM used in training=true2024.05 | 4 | 1.58 | 23.76 | 5.33 | 2.53 | 28.17 | |
| UnSAMFlow (+aug +hg)Learning Paradigm=Unsupervised, Parameters=2.5M, semantic augmentation module=true, homography smoothness loss=true, SAM used in training=true2024.05 | 4 | 1.76 | 22.36 | 5.22 | 2.62 | 26.4 | |
| UnSAMFlow (baseline)Learning Paradigm=Unsupervised, Parameters=2.5M2024.05 | 4.29 | 1.64 | 25.96 | 5.81 | 2.76 | 30.6 | |
| UPFlowLearning Paradigm=Unsupervised, Parameters=3.5M2024.05 | 4.68 | 1.71 | 28.95 | 5.32 | 2.42 | 28.93 | |
| ARFlowLearning Paradigm=Unsupervised, Parameters=2.2M2024.05 | 4.78 | 1.91 | 28.26 | 5.89 | 2.73 | 31.6 | |
| UFlowLearning Paradigm=Unsupervised2024.05 | 5.21 | 2.04 | 31.06 | 6.5 | 3.08 | 34.4 | |
| SimFlowLearning Paradigm=Unsupervised2024.05 | 5.93 | 2.16 | 36.66 | 6.92 | 3.02 | 38.7 | |
| DDFlowLearning Paradigm=Unsupervised, Parameters=4.3M2024.05 | 6.18 | 2.27 | 38.05 | 7.4 | 3.41 | 39.94 | |
| SelFlowLearning Paradigm=Unsupervised, Parameters=4.8M2024.05 | 6.56 | 2.67 | 38.3 | 6.57 | 3.12 | 34.72 | |
| UnFlow-CSSLearning Paradigm=Unsupervised, Parameters=116.6M2024.05 | 9.38 | 5.37 | 42.11 | 10.22 | 6.06 | 44.11 |