Spoken Question Answering on LibriSQA
47.33BLEU+LEAF
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| +LEAFBackbone=Granite 3 8B2026.05 | 47.33 | 69.65 | 57.69 | 66.42 | 69.71 | 94.8 | 18.6 | 3.41 | 87.67 | |
| +Full GRPOBackbone=Granite 3 8B2026.05 | 46.4 | 69.57 | 57.49 | 66.16 | 69.61 | 94.76 | — | — | — | |
| +LEAFBackbone=Qwen2-Audio2026.05 | 45.85 | 68.94 | 54.32 | 65.59 | 68.65 | 94.64 | 18.8 | 3.43 | — | |
| +LEAFBackbone=Granite 3 2B2026.05 | 45.82 | 68.84 | 54.19 | 65.6 | 68.53 | 94.64 | 18.5 | 3.34 | 86.64 | |
| +Full GRPOBackbone=Granite 3 2B2026.05 | 44.9 | 68.56 | 53.35 | 64.88 | 68.48 | 94.45 | — | — | — | |
| +LEAFBackbone=Granite 4.0 1B2026.05 | 44.61 | 67.65 | 52.6 | 64.11 | 67.37 | 94.36 | 18.6 | 3.21 | 84.38 | |
| +LoRA GRPOBackbone=Qwen2-Audio2026.05 | 40.95 | 66.42 | 51.59 | 63.05 | 66.89 | 94.06 | 20.1 | 3.32 | — | |
| +LoRA GRPOBackbone=Granite 3 2B2026.05 | 40.73 | 67.25 | 52.33 | 63.76 | 66.78 | 94.01 | 19.7 | 3.2 | 84.89 | |
| baseBackbone=Granite 3 2B2026.05 | 28.02 | 56.8 | 40.35 | 51.39 | 53.02 | 91.18 | 22.3 | 2.65 | 70.52 | |
| baseBackbone=Granite 4.0 1B2026.05 | 27.78 | 56.43 | 40 | 51 | 52.97 | 91.13 | 22.5 | 2.62 | 69.99 | |
| baseBackbone=Granite 3 8B2026.05 | 24.62 | 54.33 | 38.34 | 48.43 | 53.29 | 90.87 | 26.1 | 2.28 | 64.57 | |
| baseBackbone=Qwen2-Audio2026.05 | 12.93 | 38.14 | 24.99 | 34.59 | 40.12 | 88.19 | 45 | 2.09 | — |