Video Frame Interpolation on Middlebury
1.78Average IE ErrorOurs-Aug (DQBC)
Evaluation results
| Method | Links | |||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ours-Aug (DQBC)Test augmentation=true2023.04 | 1.78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VFIformer2023.04 | 1.82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VFIformer2022.05 | 1.82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ours (DQBC)Test augmentation=false2023.04 | 1.86 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RIFEmodel_variant=Large2022.05 | 1.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RIFE2023.04 | 1.96 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ABME2023.04 | 2.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ABME2022.05 | 2.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DAIN2023.04 | 2.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BMBC2023.04 | 2.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DAIN2022.05 | 2.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BMBC2022.05 | 2.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ToFlow2023.04 | 2.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ToFlow2022.05 | 2.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AdaCoF2023.04 | 2.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AdaCoF2022.05 | 2.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SepConv2023.04 | 2.27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SepConv2022.05 | 2.27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAIN2023.04 | 2.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAIN2022.05 | 2.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BMBC2020.07 | 4.48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.3 | 0.57 | 3.07 | 0.58 | 3.17 | 0.77 | 4.24 | 0.84 | 7.79 | 0.85 | 4.08 | 0.82 | 5.63 | 0.58 | 6.36 | 0.59 | 0.7 | |
| DAIN2019.04 | 4.86 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.38 | 0.58 | 3.28 | 0.6 | 3.32 | 0.69 | 4.65 | 0.86 | 7.88 | 0.87 | 4.73 | 0.85 | 6.36 | 0.59 | 6.25 | 0.66 | 0.71 | |
| MEMC-Net*2018.10 | 5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.39 | 0.59 | 3.36 | 0.64 | 3.37 | 0.8 | 4.84 | 0.88 | 8.55 | 0.88 | 4.7 | 0.85 | 6.4 | 0.64 | 6.37 | 0.63 | 0.74 | |
| MEMC-Net2019.04 | 5.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.47 | 0.6 | 3.49 | 0.65 | 4.63 | 1.42 | 4.94 | 0.88 | 8.91 | 0.93 | 4.7 | 0.86 | 6.46 | 0.66 | 6.35 | 0.64 | 0.83 | |
| DAIN2020.07 | 5.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.38 | 0.58 | 3.28 | 0.6 | 3.32 | 0.69 | 4.65 | 0.86 | 7.88 | 0.87 | 4.73 | 0.85 | 7.02 | 0.68 | 6.46 | 0.66 | 0.83 | |
| CtxSyn2019.04 | 5.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.24 | 0.5 | 2.96 | 0.55 | 4.32 | 1.42 | 4.21 | 0.87 | 9.59 | 0.95 | 5.22 | 0.94 | 7.02 | 0.68 | 6.66 | 0.67 | 0.82 | |
| CtxSyn2018.10 | 5.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.24 | 0.5 | 2.96 | 0.55 | 4.32 | 1.42 | 4.21 | 0.87 | 9.59 | 0.95 | 5.22 | 0.94 | 7.02 | 0.68 | 6.66 | 0.67 | 0.82 | |
| Super SloMo2019.04 | 5.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.51 | 0.59 | 3.66 | 0.72 | 2.91 | 0.74 | 5.05 | 0.98 | 9.56 | 0.94 | 5.37 | 0.96 | 6.69 | 0.6 | 6.73 | 0.69 | 0.78 | |
| SuperSlomo2018.10 | 5.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.51 | 0.59 | 3.66 | 0.72 | 2.91 | 0.74 | 5.05 | 0.98 | 9.56 | 0.94 | 5.37 | 0.96 | 6.69 | 0.6 | 6.73 | 0.69 | 0.78 | |
| MEMC-Net2018.10 | 5.35 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.83 | 0.64 | 3.84 | 0.73 | 4.16 | 0.84 | 5.75 | 0.99 | 8.57 | 0.93 | 4.99 | 0.96 | 5.86 | 0.6 | 6.83 | 0.69 | 0.8 | |
| ToFlow2019.04 | 5.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.54 | 0.55 | 3.7 | 0.72 | 3.43 | 0.92 | 5.05 | 0.96 | 9.84 | 0.97 | 5.34 | 0.98 | 6.88 | 0.72 | 7.14 | 0.9 | 0.84 | |
| CtxSyn2020.07 | 5.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.24 | 0.5 | 2.96 | 0.55 | 4.32 | 1.42 | 4.21 | 0.87 | 9.59 | 0.95 | 5.22 | 0.94 | 6.88 | 0.72 | 5.31 | 0.78 | 0.84 | |
| SepConv-L12019.04 | 5.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.52 | 0.54 | 3.56 | 0.67 | 4.17 | 1.07 | 5.41 | 1.03 | 10.2 | 0.99 | 5.47 | 0.96 | 6.88 | 0.68 | 6.63 | 0.7 | 0.83 | |
| SepConv-L12018.10 | 5.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.52 | 0.54 | 3.56 | 0.67 | 4.17 | 1.07 | 5.41 | 1.03 | 10.2 | 0.99 | 5.47 | 0.96 | 6.88 | 0.68 | 6.63 | 0.7 | 0.83 | |
| MDP-Flow22018.10 | 5.83 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.89 | 0.59 | 3.47 | 0.62 | 3.66 | 1.24 | 5.2 | 0.94 | 10.2 | 0.98 | 6.13 | 1.09 | 7.36 | 0.7 | 7.75 | 0.78 | 0.87 | |
| DeepFlow22018.10 | 5.97 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.98 | 0.62 | 3.88 | 0.74 | 3.62 | 0.86 | 5.39 | 0.99 | 11 | 1.04 | 5.91 | 1.02 | 7.14 | 0.63 | 7.8 | 0.96 | 0.86 | |
| SuperSlomo2020.07 | 6.25 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.51 | 0.59 | 3.66 | 0.72 | 2.91 | 0.74 | 5.05 | 0.98 | 9.56 | 0.94 | 5.37 | 0.96 | 6.88 | 0.68 | 5.49 | 0.84 | 0.66 | |
| ToFlow2020.07 | 6.35 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.54 | 0.55 | 3.7 | 0.72 | 3.43 | 0.92 | 5.05 | 0.96 | 9.84 | 0.97 | 5.34 | 0.98 | 6.66 | 0.67 | 5.28 | 0.82 | 0.64 | |
| EpicFlow2019.04 | 6.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 3.17 | 0.62 | 3.79 | 0.7 | 4.28 | 1.06 | 6.37 | 1.09 | 11.2 | 1.18 | 6.23 | 1.1 | 8.11 | 1 | 8.76 | 1.04 | 0.97 | |
| EpicFlow2018.10 | 6.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 3.17 | 0.62 | 3.79 | 0.7 | 4.28 | 1.06 | 6.37 | 1.09 | 11.2 | 1.18 | 6.23 | 1.1 | 8.11 | 1 | 8.76 | 1.04 | 0.97 | |
| MEMC-Net*2020.07 | 6.73 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.47 | 0.6 | 3.49 | 0.65 | 4.63 | 1.42 | 4.94 | 0.88 | 8.91 | 0.93 | 4.7 | 0.86 | 6.69 | 0.6 | 5.1 | 0.82 | 0.69 | |
| SepConv-L12020.07 | 7.14 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.52 | 0.54 | 3.56 | 0.67 | 4.17 | 1.07 | 5.41 | 1.03 | 10.2 | 0.99 | 5.47 | 0.96 | 6.63 | 0.7 | 5.61 | 0.83 | 0.9 | |
| AdaConv2017.08 | — | 3.57 | 6.88 | 1.41 | 4.34 | 5.67 | 2.52 | 5 | 5.86 | 2.98 | 6.91 | 8.89 | 4.89 | 10.2 | 12.8 | 3.21 | 5.33 | 10.1 | 2.27 | 7.3 | 16.6 | 1.92 | 6.94 | 10.8 | 1.67 | 6.2 | 9.7 | 2.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DeepFlow22017.08 | — | 2.99 | 5.65 | 1.22 | 3.88 | 5.79 | 1.48 | 3.62 | 6.03 | 1.34 | 5.38 | 7.44 | 3.22 | 11 | 13.8 | 3.67 | 5.83 | 11.2 | 2.25 | 7.6 | 17.4 | 1.5 | 7.82 | 12.2 | 1.77 | 6.02 | 9.94 | 2.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MDP-Flow22017.08 | — | 2.89 | 5.38 | 1.19 | 3.47 | 5.07 | 1.26 | 3.66 | 6.1 | 2.48 | 5.2 | 7.48 | 3.14 | 10.2 | 12.8 | 3.61 | 6.13 | 11.8 | 2.31 | 7.36 | 16.8 | 1.49 | 7.75 | 12.1 | 1.69 | 5.83 | 9.69 | 2.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SepConv-L1loss=L12017.08 | — | 2.52 | 4.83 | 1.11 | 3.56 | 5.04 | 1.9 | 4.17 | 4.15 | 2.86 | 5.41 | 6.81 | 3.88 | 10.2 | 12.8 | 3.37 | 5.47 | 10.4 | 2.21 | 6.88 | 15.6 | 1.72 | 6.63 | 10.3 | 1.62 | 5.61 | 8.74 | 2.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SepConv-LFloss=LF2017.08 | — | 2.6 | 5 | 1.19 | 3.87 | 5.5 | 2.07 | 4.38 | 4.29 | 2.73 | 5.78 | 7.16 | 3.94 | 10.1 | 12.7 | 3.39 | 5.98 | 11.4 | 2.42 | 6.85 | 15.5 | 1.78 | 6.9 | 10.8 | 1.65 | 5.81 | 9.04 | 2.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |