Generative Error Rescoring on ATIS (test)
2.1WERClozeGER + Calibration + Post-processing
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ClozeGER + Calibration + Post-processingBackbone=LLaMA-2-7b, LoRA=true, Source Speech=false, Calibration=true, Post-processing=true2024.05 | 2.1 | — | — | |
| GERBackbone=LLaMA-2-7b, LoRA=true, Source Speech=false2024.05 | 2.4 | — | — | |
| ClozeGER + CalibrationBackbone=LLaMA-2-7b, LoRA=true, Source Speech=false, Calibration=true, Post-processing=false2024.05 | 5.8 | — | — | |
| ClozeGERBackbone=LLaMA-2-7b, LoRA=true, Source Speech=false, Calibration=false, Post-processing=false2024.05 | 6.3 | — | — | |
| BaselineBackbone=Whisper2024.05 | 7.3 | — | — | |
| Oracle2024.05 | — | 4.1 | 1 |