Contextual Automatic Speech Recognition on ICI
5.78CERLLM-Refine
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLM-RefineTop-K=10, Retrieval=JSPG2026.05 | 5.78 | 4.85 | 5.99 | 93.2 | |
| LLM-RefineTop-K=50, Retrieval=JSPG2026.05 | 5.91 | 5.95 | 5.9 | 90.58 | |
| LLM-RefineTop-K=100, Retrieval=JSPG2026.05 | 5.94 | 6.05 | 5.92 | 90.58 | |
| LLM-RefineTop-K=1, Retrieval=JSPG2026.05 | 6.96 | 8.4 | 6.63 | 87.22 | |
| Multi-grainedTop-K=10, Retrieval=JSPG2026.05 | 7.71 | 11.4 | 6.85 | 79.19 | |
| Multi-grainedTop-K=50, Retrieval=JSPG2026.05 | 7.83 | 12.15 | 6.82 | 77.56 | |
| Multi-grainedTop-K=1, Retrieval=JSPG2026.05 | 7.9 | 12.7 | 6.78 | 76.68 | |
| Multi-grainedTop-K=100, Retrieval=JSPG2026.05 | 8.03 | 12.95 | 6.88 | 76.1 | |
| CopyNETop-K=10, Retrieval=JSPG2026.05 | 8.96 | 17.3 | 7.02 | 69.12 | |
| CopyNETop-K=50, Retrieval=JSPG2026.05 | 9.06 | 17.7 | 7.05 | 68.47 | |
| CopyNETop-K=100, Retrieval=JSPG2026.05 | 9.13 | 17.95 | 7.08 | 68.14 | |
| CopyNETop-K=1, Retrieval=JSPG2026.05 | 9.3 | 19.4 | 6.95 | 64.91 | |
| Whisper BaseModel=Baseline2026.05 | 11.5 | 30.7 | 6.9 | 40.8 |