Slot Filling on SLURP Whisper Small transcriptions (test)
64.6SLU-F1Flan-T5-base
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Flan-T5-baseEvaluation Protocol=fine-tuned, Training Data=Full SLURP2023.11 | 64.6 | 74.3 | 57.2 | |
| GPT-2Evaluation Protocol=fine-tuned, Training Data=Full SLURP2023.11 | 64 | 72.6 | 57.3 | |
| GPT-4Evaluation Protocol=one-shot2023.11 | 45.2 | 43.1 | 47.6 | |
| GPT-3.5Evaluation Protocol=one-shot2023.11 | 38.6 | 35 | 42.7 | |
| Vicuna-13B-v1.5Evaluation Protocol=one-shot2023.11 | 20.7 | 18.5 | 23.6 | |
| Vicuna-13BEvaluation Protocol=one-shot2023.11 | 8.1 | 5.2 | 17.9 |