List your company

ResearchFormerly WizWand

VoiceBench

Benchmarks

TaskDatasetSOTA resultTrendResults

Voice Evaluation

VoiceBench

90.1SD Score (VoiceBench)

20

General Audio Understanding

VoiceBench

86.43Overall Score

20

VoiceBench

4.78AlpacaEval Score

15

Question Answering

VoiceBench

89.23OpenbookQA Score

13

Speech-to-text reasoning and semantic understanding

VoiceBench (test)

4.8Alpaca Eval

13

VoiceBench

72.9MMSU Accuracy (Audio)

13

Audio Instruction Following

VoiceBench

4.78AlpacaEval Score

10

Spoken Question Answering

VoiceBench

76.79Accuracy

9

Spoken Dialogue Evaluation

Voicebench

4.5Alpa Score

8

General capability evaluation

Voicebench

76.91HS Score

8

Empathetic Speech Generation

VoiceBench CommonEval

4.22Empathy Score

7

Speech-to-Text Spoken Question Answering

VoiceBench S2T (test)

4.8AlpacaEval

7

VoiceBench

4.94AlpacaEval

7

Speech-to-Text Reply Quality

VoiceBench AlpacaEval

4.78Quality Score

6

Conversational Intelligence

VoiceBench

4.57AlpacaEval

6

General Conversation

VoiceBench

4.19AlpacaEval Score

5

Spoken Question Answering

VoiceBench S2T

4.94AlpacaEval

4

Speech Question Answering

VoiceBench AlpacaEval

4.81AlpacaEval Score

3

Voice Interaction

VoiceBench

89.4VoiceBench Average Score

3

VoiceBench

93.1Score

3