Generative Error Rescoring on Common Voice (test)
8.6WERClozeGER + Calibration + Post-processing
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ClozeGER + Calibration + Post-processingBackbone=LLaMA-2-7b, LoRA=true, Source Speech=false, Calibration=true, Post-processing=true2024.05 | 8.6 | — | — | |
| GERBackbone=LLaMA-2-7b, LoRA=true, Source Speech=false2024.05 | 10.8 | — | — | |
| ClozeGER + CalibrationBackbone=LLaMA-2-7b, LoRA=true, Source Speech=false, Calibration=true, Post-processing=false2024.05 | 12.4 | — | — | |
| ClozeGERBackbone=LLaMA-2-7b, LoRA=true, Source Speech=false, Calibration=false, Post-processing=false2024.05 | 13.1 | — | — | |
| BaselineBackbone=Whisper2024.05 | 14.4 | — | — | |
| Oracle2024.05 | — | 10.5 | 7.5 |