Underwater Acoustic Classification on VTUAD
96.3Classification AccuracyFull fine tune
Evaluation results
| Method | Links | |
|---|---|---|
| Full fine tuneParams=86.9M2025.04 | 96.3 | |
| SSFconfig=MHSA & FFN, Params=22.5K2025.04 | 92.2 | |
| SSFconfig=MHSA, Params=13.3K2025.04 | 90.5 | |
| HPTbins=16, site=MHSA, Params=18.0K2025.04 | 88.1 | |
| Student + ResNet38Teacher Model=ResNet38, # Parameters (Student vs. Teacher)=12.3K vs. 72.7M, Adaptation Strategy=Full teacher fine-tuning2025.01 | 86.87 | |
| Student + CNN14Teacher Model=CNN14, # Parameters (Student vs. Teacher)=12.3K vs. 79.7M, Adaptation Strategy=Full teacher fine-tuning2025.01 | 86.55 | |
| Student + HuBERTTeacher Model=HuBERT, # Parameters (Student vs. Teacher)=12.3K vs. 95.7M, Adaptation Strategy=Full teacher fine-tuning2025.01 | 86.54 | |
| HPTbins=8, site=MHSA, Params=11.8K2025.04 | 86.4 | |
| SSFconfig=LayerNorm, Params=7.2K2025.04 | 86.3 | |
| SSATKDFramework=torchdistill [76], Teacher architectures=averaged over six, Independent runs=three2025.01 | 85.49 | |
| Student + MobileNetV1Teacher Model=MobileNetV1, # Parameters (Student vs. Teacher)=12.3K vs. 4.3M, Adaptation Strategy=Full teacher fine-tuning2025.01 | 85.37 | |
| Student + WhisperTeacher Model=Whisper, # Parameters (Student vs. Teacher)=12.3K vs. 74.0M, Adaptation Strategy=Full teacher fine-tuning2025.01 | 85.24 | |
| Student + Wav2Vec 2.0Teacher Model=Wav2Vec 2.0, # Parameters (Student vs. Teacher)=12.3K vs. 95.0M, Adaptation Strategy=Full teacher fine-tuning2025.01 | 85.17 | |
| HPTbins=4, site=MHSA, Params=8.7K2025.04 | 85 | |
| LoRArank=12, Params=24.1K2025.04 | 84.3 | |
| LoRArank=6, Params=14.9K2025.04 | 82.6 | |
| CCKDFramework=torchdistill [76], Teacher architectures=averaged over six, Independent runs=three2025.01 | 82.49 | |
| SRDFramework=torchdistill [76], Teacher architectures=averaged over six, Independent runs=three2025.01 | 82.41 | |
| TF-KDFramework=torchdistill [76], Teacher architectures=averaged over six, Independent runs=three2025.01 | 81.51 | |
| CRDFramework=torchdistill [76], Teacher architectures=averaged over six, Independent runs=three2025.01 | 81.38 | |
| Student Only# Parameters=11.3K2025.01 | 80.49 | |
| Linear probeParams=5.6K2025.04 | 79.9 | |
| PADFramework=torchdistill [76], Teacher architectures=averaged over six, Independent runs=three2025.01 | 78.75 |