Slot Filling on SUPERB SF
92.21F1 ScoreWavLM Large
Evaluation results
| Method | Links | ||
|---|---|---|---|
| WavLM Large# Params=316.6M, Evaluation Protocol=Frozen-encoder2026.06 | 92.21 | 18.36 | |
| WavLM Base+# Params=94.7M, Evaluation Protocol=Frozen-encoder2026.06 | 90.58 | 21.2 | |
| HuBERT Large# Params=316.6M, Evaluation Protocol=Frozen-encoder2026.06 | 89.81 | 21.76 | |
| WavLM Base# Params=94.7M, Evaluation Protocol=Frozen-encoder2026.06 | 89.38 | 22.86 | |
| HuBERTSchedule=-, Speed=-, #Params=94.68M2026.06 | 88.53 | 25.2 | |
| HuBERT Base# Params=94.7M, Evaluation Protocol=Frozen-encoder2026.06 | 88.53 | 25.2 | |
| wav2vec 2.0 Base# Params=95.0M, Evaluation Protocol=Frozen-encoder2026.06 | 88.3 | 24.77 | |
| ARMHuBERTSchedule=-, Speed=-, #Params=26.45M2026.06 | 87.59 | 26.06 | |
| wav2vec 2.0 Large# Params=316.6M, Evaluation Protocol=Frozen-encoder2026.06 | 87.11 | 27.31 | |
| DPHuBERTSchedule=-, Speed=-, #Params=23.59M2026.06 | 86.86 | 28.26 | |
| Full L2LSchedule=-, Speed=×1.00, #Params=26.87M2026.06 | 86.47 | 28.58 | |
| InterleaveStackSchedule=EQL, Speed=×1.24, #Params=26.87M2026.06 | 86.36 | 27.5 | |
| 12-L HALF L2LSchedule=-, Speed=-, #Params=26.87M2026.06 | 86.11 | 30.93 | |
| InterleaveStackSchedule=PROP-1, Speed=×1.16, #Params=26.87M2026.06 | 85.7 | 28.45 | |
| 12-L HALFSchedule=-, Speed=-, #Params=26.87M2026.06 | 84.49 | 32.54 | |
| MIDASSchedule=PROP-1, Speed=×1.17, #Params=26.87M2026.06 | 84.37 | 30.56 | |
| GradStackSchedule=PROP-1, Speed=×1.17, #Params=26.87M2026.06 | 84.35 | 31.5 | |
| GradStackSchedule=EQL, Speed=×1.25, #Params=26.87M2026.06 | 84.34 | 31.15 | |
| MIDASSchedule=EQL, Speed=×1.25, #Params=26.87M2026.06 | 83.43 | 32.22 | |
| FullSchedule=-, Speed=×1.05, #Params=26.87M2026.06 | 83.42 | 31.62 | |
| DeCoAR 2.0# Params=89.8M, Evaluation Protocol=Frozen-encoder2026.06 | 83.28 | 34.73 | |
| S-JEPA# Params=51.8M, Evaluation Protocol=Frozen-encoder2026.06 | 83.05 | 33.17 | |
| DistilHuBERTSchedule=-, Speed=-, #Params=23.49M2026.06 | 82.57 | 35.59 | |
| DistilHuBERT# Params=23.5M, Evaluation Protocol=Frozen-encoder2026.06 | 82.57 | 35.59 | |
| vq-wav2vec# Params=34.2M, Evaluation Protocol=Frozen-encoder2026.06 | 77.68 | 41.54 | |
| wav2vec# Params=32.5M, Evaluation Protocol=Frozen-encoder2026.06 | 76.37 | 43.71 | |
| NPC# Params=19.4M, Evaluation Protocol=Frozen-encoder2026.06 | 72.79 | 48.44 | |
| modified CPC# Params=1.8M, Evaluation Protocol=Frozen-encoder2026.06 | 71.19 | 49.91 | |
| APC# Params=4.1M, Evaluation Protocol=Frozen-encoder2026.06 | 70.46 | 50.89 | |
| VQ-APC# Params=4.6M, Evaluation Protocol=Frozen-encoder2026.06 | 68.53 | 52.91 | |
| TERA# Params=21.3M, Evaluation Protocol=Frozen-encoder2026.06 | 67.5 | 54.17 | |
| PASE+# Params=7.8M, Evaluation Protocol=Frozen-encoder2026.06 | 62.14 | 60.17 | |
| Mockingjay# Params=85.1M, Evaluation Protocol=Frozen-encoder2026.06 | 61.59 | 58.89 |