Automatic Speech Recognition on ATCO2 1-hour (test)
17.17WERWhisper-small, BEARD (5381 h) + FT
Evaluation Results
| Method | Links | |
|---|---|---|
| Whisper-small, BEARD (5381 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=6, Distillation weight λ=0.52025.10 | 17.17 | |
| Whisper-small, BEARD (500 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=6, Distillation weight λ=0.52025.10 | 17.53 | |
| Whisper-small, BEARD (5381 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=4, Distillation weight λ=1.02025.10 | 17.58 | |
| Whisper-small, BEARD (5381 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=5, Distillation weight λ=0.52025.10 | 17.72 | |
| Whisper-small, BEARD (5381 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=7, Distillation weight λ=0.52025.10 | 17.87 | |
| Whisper-small, BEARD (5381 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=4, Distillation weight λ=0.52025.10 | 18.01 | |
| Whisper-small, BEARD (5381 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=6, Distillation weight λ=1.02025.10 | 18.05 | |
| Whisper-small, BEARD (5381 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=5, Distillation weight λ=1.02025.10 | 18.06 | |
| Whisper-small, BEARD (1000 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=6, Distillation weight λ=0.52025.10 | 18.06 | |
| Whisper-small, BEARD (5381 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=8, Distillation weight λ=1.02025.10 | 18.27 | |
| Whisper-small, BEARD (5381 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=8, Distillation weight λ=0.52025.10 | 18.4 | |
| Whisper-small, BEARD (2000 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=6, Distillation weight λ=0.52025.10 | 18.4 | |
| Whisper-small, FT# FT params.=244M, ATCO2 for FT=2 h 24 min2025.10 | 19.54 | |
| Whisper-small, BEARD (5381 h) + FT# FT params.=244M, ATCO2 for FT=2 h 24 min, Layer ℓ=7, Distillation weight λ=1.02025.10 | 19.68 | |
| XLS-R (FT ATC) + LM# FT params.=300M, ATCO2 for FT=0 min2025.10 | 19.8 | |
| Whisper-small, FT# FT params.=244M, ATCO2 for FT=52 min2025.10 | 22.79 | |
| Whisper-small, no FT# FT params.=0, ATCO2 for FT=0 min2025.10 | 63.32 |