Video Frame Interpolation on UCF101
35.44PSNROurs-Aug (DQBC)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Ours-Aug (DQBC)Test augmentation=true2023.04 | 35.44 | 97 | |
| Ours-tripletstraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=28.9, Runtime (ms)=6802022.03 | 35.43 | 97.9 | |
| NCM (Ours-Large)2022.07 | 35.43 | 97 | |
| VFIformer2023.04 | 35.43 | 97 | |
| VFIformer2022.05 | 35.43 | 97 | |
| RIFE-Large2022.07 | 35.41 | 97 | |
| EBME-H*parameters (millions)=3.9, runtime (seconds)=0.082022.06 | 35.41 | 97 | |
| SoftSplattraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=7.7, Runtime (ms)=1352022.03 | 35.39 | 97 | |
| SoftSplatGFLOPS (share)=95, GFLOPS (unshare)=218, Speed (ms/f)=122, Arbitrary Interpolation=true2022.04 | 35.39 | 97 | |
| SoftSplatRuntime (ms) 480p=135*, Parameters (Million)=7.7*2022.07 | 35.39 | 97 | |
| SoftSplat2022.06 | 35.39 | 95.2 | |
| ABME2022.02 | 35.38 | 96.98 | |
| ABMEGFLOPS (share)=N/A, GFLOPS (unshare)=549, Speed (ms/f)=497, Arbitrary Interpolation=true2022.04 | 35.38 | 97 | |
| ABME2022.07 | 35.38 | 96.98 | |
| ABMEparameters (millions)=18.1, runtime (seconds)=0.282022.06 | 35.38 | 97 | |
| ABME2023.04 | 35.38 | 96.98 | |
| ABME2022.05 | 35.38 | 96.98 | |
| CURE2022.02 | 35.36 | 97.05 | |
| NCM (Ours-Base)2022.07 | 35.36 | 96.95 | |
| EBME-Hparameters (millions)=3.9, runtime (seconds)=0.042022.06 | 35.35 | 96.9 | |
| Ours (DQBC)Test augmentation=false2023.04 | 35.35 | 96.96 | |
| EBMEparameters (millions)=3.9, runtime (seconds)=0.022022.06 | 35.3 | 96.9 | |
| SepConv++training dataset=Vimeo-Triplets-Train, self-ensembling=true2022.03 | 35.29 | — | |
| RIFE-Ltraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=20.9, Runtime (ms)=722022.03 | 35.29 | 96.9 | |
| RIFE2023.04 | 35.29 | 96.9 | |
| RIFEmodel_variant=Large2022.05 | 35.29 | 96.93 | |
| RIFE2022.07 | 35.28 | 96.9 | |
| RIFEGFLOPS (share)=N/A, GFLOPS (unshare)=20, Speed (ms/f)=17, Arbitrary Interpolation=true2022.04 | 35.25 | 96.9 | |
| XVFI2022.07 | 35.18 | 96.85 | |
| XVFIparameters (millions)=5.5, runtime (seconds)=0.12022.06 | 35.18 | 95.2 | |
| M2M-PWCGFLOPS (share)=87, GFLOPS (unshare)=< 1, Speed (ms/f)=32, Arbitrary Interpolation=true2022.04 | 35.17 | 97 | |
| BMBC2022.02 | 35.16 | 96.89 | |
| BMBCtraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=11.0, Runtime (ms)=15802022.03 | 35.15 | 96.9 | |
| BMBCGFLOPS (share)=441, GFLOPS (unshare)=376, Speed (ms/f)=1213, Arbitrary Interpolation=true2022.04 | 35.15 | 96.9 | |
| BMBC2022.07 | 35.15 | 96.89 | |
| BMBCparameters (millions)=11, runtime (seconds)=0.822022.06 | 35.15 | 96.9 | |
| BMBC2023.04 | 35.15 | 96.89 | |
| BMBC2022.05 | 35.15 | 96.89 | |
| EDSCtraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=8.9, Runtime (ms)=462022.03 | 35.13 | 96.8 | |
| M2M-DISGFLOPS (share)=61, GFLOPS (unshare)=< 1, Speed (ms/f)=28, Arbitrary Interpolation=true2022.04 | 35.13 | 96.8 | |
| CyclicGen2023.04 | 35.11 | 96.84 | |
| CyclicGen2022.05 | 35.11 | 96.84 | |
| XVFI2022.02 | 35.09 | 96.85 | |
| DSepConvtraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=21.8, Runtime (ms)=2362022.03 | 35.08 | 96.9 | |
| FeFlowtraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=133.62022.03 | 35.08 | 95.7 | |
| MEMC-Net*2018.10 | 35.01 | 96.83 | |
| MEMC-Nettraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=70.3, Runtime (ms)=1202022.03 | 35.01 | 96.8 | |
| DAINtraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=24.0, Runtime (ms)=1302022.03 | 35 | 96.8 | |
| PWDNtraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=7.82022.03 | 35 | — | |
| DAINGFLOPS (share)=712, GFLOPS (unshare)=1308, Speed (ms/f)=977, Arbitrary Interpolation=true2022.04 | 35 | 96.8 | |
| DAIN2022.07 | 34.99 | 96.83 | |
| DAINparameters (millions)=24, runtime (seconds)=0.152022.06 | 34.99 | 96.8 | |
| DAIN2023.04 | 34.99 | 96.83 | |
| DAIN2022.05 | 34.99 | 96.83 | |
| CAINtraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=42.8, Runtime (ms)=382022.03 | 34.98 | 96.9 | |
| CAINGFLOPS (share)=N/A, GFLOPS (unshare)=29, Speed (ms/f)=47, Arbitrary Interpolation=false2022.04 | 34.98 | 96.9 | |
| ECMparameters (millions)=4.72022.06 | 34.97 | 95.1 | |
| MEMC-Net2018.10 | 34.95 | 96.79 | |
| RRIN2022.02 | 34.93 | 94.96 | |
| CAIN2022.02 | 34.91 | 96.9 | |
| CAINparameters (millions)=42.8, runtime (seconds)=0.042022.06 | 34.91 | 96.9 | |
| CAIN2023.04 | 34.91 | 96.9 | |
| CAIN2022.05 | 34.91 | 96.9 | |
| AdaCoF2022.02 | 34.9 | 96.8 | |
| AdaCoFGFLOPS (share)=N/A, GFLOPS (unshare)=117, Speed (ms/f)=36, Arbitrary Interpolation=false2022.04 | 34.9 | 96.8 | |
| AdaCoF2022.07 | 34.9 | 96.8 | |
| AdaCoFparameters (millions)=22.9, runtime (seconds)=0.032022.06 | 34.9 | 96.8 | |
| AdaCoF2023.04 | 34.9 | 96.8 | |
| AdaCoF2022.05 | 34.9 | 96.8 | |
| MEMC-Net_sScale=Small2018.10 | 34.83 | 96.76 | |
| SepConvLoss=L12018.10 | 34.78 | 96.69 | |
| SepConvtraining dataset=proprietary, # Parameters (Million)=21.6, Runtime (ms)=512022.03 | 34.78 | 96.7 | |
| SepConvGFLOPS (share)=N/A, GFLOPS (unshare)=93, Speed (ms/f)=101, Arbitrary Interpolation=false2022.04 | 34.78 | 96.7 | |
| SepConv2023.04 | 34.78 | 96.69 | |
| SepConv2022.05 | 34.78 | 96.69 | |
| SepConvLoss=Lf2018.10 | 34.69 | 96.55 | |
| ToFlow+MaskMasking=true2018.10 | 34.58 | 96.67 | |
| ToFlow2022.02 | 34.58 | 96.67 | |
| TOFlowtraining dataset=Vimeo-Triplets-Train, # Parameters (Million)=1.1, Runtime (ms)=722022.03 | 34.58 | 96.7 | |
| ToFlow2023.04 | 34.58 | 96.67 | |
| ToFlow2022.05 | 34.58 | 96.67 | |
| ToFlow2018.10 | 34.54 | 96.66 | |
| DVF2018.10 | 34.12 | 96.31 | |
| MIND2018.10 | 33.93 | 96.61 | |
| EpicFlow2018.10 | 33.71 | 96.35 | |
| SPyNet2018.10 | 33.67 | 96.33 | |
| VFIT-B# Parameters (M)=29.02021.11 | 33.44 | 97.1 | |
| VFIT-S# Parameters (M)=7.52021.11 | 33.36 | 97.1 | |
| FLAVR# Parameters (M)=42.42021.11 | 33.33 | 97.1 | |
| FLAVRInputs=RGB, Interpolation factor=2x2020.12 | 33.31 | 97.1 | |
| FLAVRInputs=R2022.01 | 33.31 | 97.1 | |
| VRTInputs=R2022.01 | 33.3 | 97 | |
| QVIInputs=RGB+Flow, Interpolation factor=2x2020.12 | 32.89 | 97 | |
| QVI# Parameters (M)=29.22021.11 | 32.89 | 97 | |
| SoftSplat# Parameters (M)=7.72021.11 | 32.89 | 97 | |
| QVIInputs=R+F2022.01 | 32.89 | 97 | |
| AdaCoFInputs=RGB, Interpolation factor=2x2020.12 | 32.71 | 96.9 | |
| AdaCoF# Parameters (M)=21.82021.11 | 32.71 | 96.9 | |
| AdaCoFInputs=R2022.01 | 32.71 | 96.9 | |
| BMBCInputs=RGB, Interpolation factor=2x2020.12 | 32.61 | 95.5 |