Video Subject Swapping on Custom Video Subject Swapping Dataset (test)
81Subject IdentityVideoSwap
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VideoSwapComparison Baseline=Rerender-A-Video2023.12 | 81 | 72 | 84 | 84 | |
| VideoSwapComparison Baseline=Tune-A-Video2023.12 | 80 | 72 | 80 | 70 | |
| VideoSwapComparison Baseline=Text2Video-Zero2023.12 | 76 | 71 | 80 | 80 | |
| VideoSwapComparison Baseline=FateZero2023.12 | 74 | 67 | 78 | 73 | |
| VideoSwapBase Model=AnimateDiff, Comparison Baseline=DDIM2023.12 | 70 | 74 | 69 | 73 | |
| VideoSwapBase Model=AnimateDiff, Comparison Baseline=DDIM+Tune-A-Video2023.12 | 68 | 60 | 66 | 69 | |
| VideoSwapBase Model=AnimateDiff, Comparison Baseline=DDIM+T2I-Adapter2023.12 | 66 | 59 | 65 | 66 | |
| DDIM+T2I-AdapterBase Model=AnimateDiff2023.12 | 34 | 41 | 35 | 34 | |
| DDIM+TAVBase Model=AnimateDiff, Note=TAV refers to Tune-A-Video motion injection2023.12 | 32 | 40 | 34 | 31 | |
| DDIMBase Model=AnimateDiff2023.12 | 30 | 26 | 31 | 27 | |
| FateZeroComparison Target=VideoSwap2023.12 | 26 | 33 | 22 | 27 | |
| Text2Video-ZeroComparison Target=VideoSwap2023.12 | 24 | 29 | 20 | 20 | |
| Tune-A-VideoComparison Target=VideoSwap2023.12 | 20 | 28 | 20 | 30 | |
| Rerender-A-VideoComparison Target=VideoSwap2023.12 | 19 | 28 | 16 | 16 |