# Speech Translation on Fisher Code-Switching (test)

Source: [Speech Translation on Fisher Code-Switching (test)](<https://www.sota2.com/research/sota/speech-translation-on-fisher-code-switching-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-13T10:34:31.529Z

Evaluation of Speech Translation performance on the test split of the Fisher Code-Switching corpus, measured using BLEU and COMET scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Speech Translation |
| Dataset (including any stated split) | Fisher Code-Switching (test) |
| Metric | BLEU |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [BLEU](<https://www.sota2.com/research/sota/speech-translation-on-fisher-code-switching-test.md?metric=BLEU>): Higher is better; unit: PERCENT.

- [COMET](<https://www.sota2.com/research/sota/speech-translation-on-fisher-code-switching-test.md?metric=COMET>): Higher is better; unit: PERCENT.

## Recorded results

| Method | BLEU | Result date | Report paper |
| --- | --- | --- | --- |
| CSST-SSA | 37.51 | Not recorded | 691aac496750be83fe5ce5aa |
| CSST-SSA | 37.51 | Not recorded | 691aac496750be83fe5ce5aa |
| SeamlessM4T | 36.89 | Not recorded | 691aac496750be83fe5ce5aa |
| Voxtral-Small-24B-2507 | 36.51 | Not recorded | 691aac496750be83fe5ce5aa |
| Qwen3-Omni-30B-A3B-Instruct | 34.89 | Not recorded | 691aac496750be83fe5ce5aa |
| Voxtral-Mini-3B-2507 | 34.85 | Not recorded | 691aac496750be83fe5ce5aa |
| LLaST | 33.78 | Not recorded | 691aac496750be83fe5ce5aa |
| Whisper | 31.56 | Not recorded | 691aac496750be83fe5ce5aa |
| Whisper+LLaMA | 29.67 | Not recorded | 691aac496750be83fe5ce5aa |
| Qwen2-Audio-7B-Instruct | 21.23 | Not recorded | 691aac496750be83fe5ce5aa |
| SALMONN-13B | 20.52 | Not recorded | 691aac496750be83fe5ce5aa |

### CSST-SSA

BLEU: 37.51. Result ID: 6a04524447f34ce924ead984.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### CSST-SSA

BLEU: 37.51. Result ID: 6a04524447f34ce924ead99b.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SeamlessM4T

BLEU: 36.89. Result ID: 6a04524447f34ce924ead998.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71601e209131cea50f34.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Voxtral-Small-24B-2507

BLEU: 36.51. Result ID: 6a04524447f34ce924ead983.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1c1e209131cea813c5.md>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### Qwen3-Omni-30B-A3B-Instruct

BLEU: 34.89. Result ID: 6a04524447f34ce924ead981.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b881e209131cea88f3d.md>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### Voxtral-Mini-3B-2507

BLEU: 34.85. Result ID: 6a04524447f34ce924ead982.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a1c1e209131cea813c5.md>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### LLaST

BLEU: 33.78. Result ID: 6a04524447f34ce924ead99a.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa742d1e209131cea603ff.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Whisper

BLEU: 31.56. Result ID: 6a04524447f34ce924ead997.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e51b.md>)

[Implementation](<https://github.com/openai/whisper>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Whisper+LLaMA

BLEU: 29.67. Result ID: 6a04524447f34ce924ead999.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

Recorded evaluation configuration: {"Architecture":"cascaded"}. This record does not assert independent reproduction.

### Qwen2-Audio-7B-Instruct

BLEU: 21.23. Result ID: 6a04524447f34ce924ead980.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6017e.md>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### SALMONN-13B

BLEU: 20.52. Result ID: 6a04524447f34ce924ead97f.

[Reporting paper](<https://www.sota2.com/research/paper/691aac496750be83fe5ce5aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d71e209131cea58d8a.md>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
