Video-to-Audio on VGGSound (test)
35.41IB-scorePAVAS-L
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PAVAS-LParams=1.04B, Sampling Rate=44.1kHz, Use text input=true2025.12 | 35.41 | 0.378 | 47.38 | 3.99 | 1.15 | 1.55 | 1.35 | 17.51 | 0.446 | — | — | — | — | |
| ThinkSoundParams=1.30B, Evaluation Source=reproduced using official evaluation code, Use text prompt during testing=true2026.03 | 34.13 | — | 54.92 | — | — | 1.32 | 1.52 | 16.03 | 0.46 | — | — | — | — | |
| MMAudio-DPOParams=1.03B, Use text prompt during testing=true, Optimization Framework=V2A-DPO2026.03 | 34.08 | — | 51.38 | — | — | 1.38 | 1.34 | 19.21 | 0.35 | — | — | — | — | |
| See & HearParams=415M, Sampling Rate=16kHz, Use text input=true2025.12 | 33.99 | 0.566 | 219 | 24.58 | 5.4 | 2.26 | 2.3 | 8.58 | 1.204 | — | — | — | — | |
| Seeing&HearingParams=415M, Evaluation Source=[18], Use text prompt during testing=true2026.03 | 33.99 | — | 219.01 | — | — | 2.26 | 2.3 | 8.58 | 1.2 | — | — | — | — | |
| MMAudio-DDPOParams=1.03B, Use text prompt during testing=true2026.03 | 33.89 | — | 54.81 | — | — | 1.42 | 1.36 | 18.34 | 0.39 | — | — | — | — | |
| MMAudio-LParams=1.03B, Sampling Rate=44.1kHz, Use text input=true2025.12 | 33.22 | 0.536 | 60.6 | 4.72 | 0.97 | 1.65 | 1.4 | 17.4 | 0.442 | — | — | — | — | |
| MMAudioParams=1.03B, Use text prompt during testing=true2026.03 | 33.22 | — | 60.6 | — | — | 1.65 | 1.4 | 17.4 | 0.44 | — | — | — | — | |
| V-AURAParams=695M, Sampling Rate=16kHz, Use text input=false2025.12 | 27.64 | 0.654 | 218.5 | 14.8 | 2.88 | 2.42 | 2.07 | 10.08 | 0.654 | — | — | — | — | |
| V-AURAParams=695M, Evaluation Source=[18], Use text prompt during testing=false2026.03 | 27.64 | — | 218.5 | — | — | 2.42 | 2.07 | 10.08 | 0.65 | — | — | — | — | |
| FoleyCrafterParams=1.22B, Sampling Rate=16kHz, Use text input=true2025.12 | 25.68 | 0.588 | 140.1 | 16.24 | 2.51 | 2.3 | 2.23 | 15.68 | 1.225 | — | — | — | — | |
| FoleyCrafterParams=1.22B, Evaluation Source=[18], Use text prompt during testing=true2026.03 | 25.68 | — | 140.09 | — | — | 2.3 | 2.23 | 15.68 | 1.23 | — | — | — | — | |
| VATTSampling Rate=16kHz, Use text input=true2025.12 | 25 | 0.673 | 131.9 | 10.63 | 2.77 | 1.48 | 1.41 | 11.9 | 1.195 | — | — | — | — | |
| Frieren-DPOParams=159M, Use text prompt during testing=false, Optimization Framework=V2A-DPO2026.03 | 24.11 | — | 69.98 | — | — | 2.55 | 2.63 | 13.98 | 0.62 | — | — | — | — | |
| Frieren-DDPOParams=159M, Use text prompt during testing=false2026.03 | 23.19 | — | 75.41 | — | — | 2.58 | 2.61 | 13.12 | 0.65 | — | — | — | — | |
| TAROParams=258M, Sampling Rate=16kHz, Use text input=false2025.12 | 22.85 | 0.758 | 159.1 | 10.49 | 1.57 | 2.92 | 2.67 | 9.62 | 1.169 | — | — | — | — | |
| FrierenParams=159M, Sampling Rate=16kHz, Use text input=false2025.12 | 22.78 | 0.662 | 106.1 | 11.45 | 1.34 | 2.73 | 2.86 | 12.25 | 0.851 | — | — | — | — | |
| FrierenParams=159M, Use text prompt during testing=false2026.03 | 22.78 | — | 106.1 | — | — | 2.73 | 2.86 | 12.25 | 0.85 | — | — | — | — | |
| V2A-MapperParams=229M, Sampling Rate=16kHz, Use text input=false2025.12 | 22.58 | 0.671 | 84.57 | 8.4 | 0.84 | 2.69 | 2.56 | 12.47 | 1.225 | — | — | — | — | |
| V2A-MapperParams=229M, Evaluation Source=[18], Use text prompt during testing=false2026.03 | 22.58 | — | 84.57 | — | — | 2.69 | 2.56 | 12.47 | 1.23 | — | — | — | — | |
| MMAudioGen Type=FM, #Param Tokenizer=298.5M, #Param Generator=1.3B2026.06 | 0.291 | — | — | — | — | — | — | — | 0.813 | — | — | — | 17.09 | |
| AVTok-V2AGen Type=AR, #Param Tokenizer=208.4M, #Param Generator=632.0M2026.06 | 0.249 | — | — | — | — | — | — | — | 1.239 | — | — | — | 49.47 | |
| V-AURAGen Type=AR, #Param Tokenizer=76.7M, #Param Generator=816.9M2026.06 | 0.231 | — | — | — | — | — | — | — | 0.967 | — | — | — | 126.92 | |
| SpecVQGANGen Type=AR, #Param Tokenizer=76.4M, #Param Generator=332.4M2026.06 | 0.1 | — | — | — | — | — | — | — | 1.291 | — | — | — | 210.07 | |
| VinTAGeGen Type=FM, #Param Tokenizer=110.6M, #Param Generator=1.5B2026.06 | 0.044 | — | — | — | — | — | — | — | 1.294 | — | — | — | 80.06 | |
| Audio-OmniModel Type=Unified Models2026.04 | — | — | — | — | — | — | — | — | — | 1.71 | — | — | — | |
| AudioXModel Type=Specialized Models2026.04 | — | — | — | — | — | — | — | — | — | 1.13 | — | — | — | |
| Cross EntropySupervision=Unpaired2026.06 | — | — | — | — | — | — | — | — | — | — | 54.4 | — | — | |
| Feature KDSupervision=Unpaired2026.06 | — | — | — | — | — | — | — | — | — | — | 52.08 | — | — | |
| MMAudioModel Type=Specialized Models2026.04 | — | — | — | — | — | — | — | — | — | 2.04 | — | — | — | |
| TeacherRole=Source Model2026.06 | — | — | — | — | — | — | — | — | — | — | 44.43 | — | — | |
| UCMKDSupervision=Unpaired2026.06 | — | — | — | — | — | — | — | — | — | — | 56.84 | — | — | |
| Vanilla KDSupervision=Paired2026.06 | — | — | — | — | — | — | — | — | — | — | 51.71 | — | — | |
| VATTModel Type=Specialized Models2026.04 | — | — | — | — | — | — | — | — | — | 2.55 | — | — | — |