Audio-visual speech separation on LRS2-2Mix (test)
16SI-SNRiIIANet
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| IIANet2023.08 | 16 | 16.2 | — | |
| IIANet2023.08 | 16 | 16.2 | 3.23 | |
| IIANetMACs (G)=18.6, Params (M)=3.1, CPU (s)=1.27, GPU (ms)=110.11, GPU Memory (MB)=12.52023.08 | 16 | 16.2 | 3.23 | |
| IIANet-fast2023.08 | 15.1 | 15.4 | 3.11 | |
| IIANet-fastMACs (G)=11.9, Params (M)=3.1, CPU (s)=0.52, GPU (ms)=70.94, GPU Memory (MB)=12.52023.08 | 15.1 | 15.4 | 3.11 | |
| RTFS-Net-12Params (M)=0.7, MACS (G)=56.4, Time (ms)=109.92023.09 | 14.9 | 15.1 | 3.07 | |
| RTFS-Net-6Params (M)=0.7, MACS (G)=30.5, Time (ms)=64.72023.09 | 14.6 | 14.8 | 3.03 | |
| CTCNet2022.12 | 14.4 | — | — | |
| CTCNet2023.08 | 14.3 | 14.6 | — | |
| CTCNet2023.08 | 14.3 | 14.6 | 3.08 | |
| CTCNetMACs (G)=167.1, Params (M)=7.0, CPU (s)=1.26, GPU (ms)=84.17, GPU Memory (MB)=75.82023.08 | 14.3 | 14.6 | 3.08 | |
| CTCNetParams (M)=7.0, MACS (G)=167.2, Time (ms)=122.72023.09 | 14.3 | 14.6 | 3.08 | |
| RTFS-Net-4Params (M)=0.7, MACS (G)=21.9, Time (ms)=57.82023.09 | 14.1 | 14.3 | 3.02 | |
| AVLIT-82023.08 | 12.8 | 13.1 | — | |
| AVLIT-82023.08 | 12.8 | 13.1 | 2.56 | |
| AVLITMACs (G)=18.2, Params (M)=5.8, CPU (s)=0.46, GPU (ms)=62.51, GPU Memory (MB)=24.02023.08 | 12.8 | 13.1 | 2.56 | |
| AVLIT-82022.12 | 12.8 | — | — | |
| AVLITParams (M)=5.8, MACS (G)=36.4, Time (ms)=53.42023.09 | 12.8 | 13.1 | 2.56 | |
| AVConvTasNet2023.08 | 12.5 | 12.8 | — | |
| AVConvTasNet2023.08 | 12.5 | 12.8 | 2.69 | |
| AVConvTasNetMACs (G)=23.8, Params (M)=16.5, CPU (s)=1.06, GPU (ms)=62.51, GPU Memory (MB)=117.052023.08 | 12.5 | 12.8 | 2.69 | |
| CaffNet-CPhase Information Usage=GT phase + estimated amplitude2022.12 | 12.5 | — | — | |
| AV-ConvTasNet2022.12 | 12.5 | — | — | |
| CaffNet-C*2023.09 | 12.5 | 1.15 | — | |
| AV-ConvTasnetParams (M)=16.5, Time (ms)=60.32023.09 | 12.5 | 12.8 | — | |
| VisualVoice2022.12 | 11.8 | — | — | |
| Thanh-Dat2023.09 | 11.6 | — | — | |
| Visualvoice2023.08 | 11.5 | 11.8 | 2.78 | |
| VisualvoiceMACs (G)=9.7, Params (M)=77.8, CPU (s)=2.98, GPU (ms)=110.31, GPU Memory (MB)=313.742023.08 | 11.5 | 11.8 | 2.78 | |
| VisualVoiceParams (M)=77.8, Time (ms)=130.22023.09 | 11.5 | 11.8 | 2.78 | |
| LWTNet2023.08 | 10.8 | — | — | |
| CaffNet-C2023.08 | 10 | — | 1.15 | |
| CaffNet-CPhase Information Usage=Standard2022.12 | 10 | — | — |