ASR Rescoring on ATIS (test)
6.39WERInstructGPT
Evaluation Results
| Method | Links | |
|---|---|---|
| InstructGPTrescoring_pipeline=P2, frozen=true, task-activating prompting (TAP)=true, base_input=First pass (b)2023.09 | 6.39 | |
| Oracledescription=Lower bound baseline2023.09 | 6.43 | |
| InstructGPTrescoring_pipeline=P2, frozen=true, base_input=First pass (b)2023.09 | 7.15 | |
| BLOOMrescoring_pipeline=P2, frozen=true, task-activating prompting (TAP)=true, base_input=First pass (b)2023.09 | 8.42 | |
| 4-gram LMbase_input=First pass (b)2023.09 | 8.57 | |
| OpenLLaMArescoring_pipeline=P2, frozen=true, task-activating prompting (TAP)=true, base_input=First pass (b)2023.09 | 8.61 | |
| First passdescription=Baseline ASR output2023.09 | 8.82 | |
| BLOOMrescoring_pipeline=P2, frozen=true, base_input=First pass (b)2023.09 | 9.21 | |
| OpenLLaMArescoring_pipeline=P2, frozen=true, base_input=First pass (b)2023.09 | 9.27 | |
| GPT-2rescoring_pipeline=P2, frozen=true, base_input=First pass (b)2023.09 | 27.51 | |
| GPT-2rescoring_pipeline=P2, frozen=true, task-activating prompting (TAP)=true, base_input=First pass (b)2023.09 | 27.59 |