List your company
ResearchFormerly WizWand

Question Answering on Llama Questions

75.3AccuracyDuplexPO
-2.970417.349837.6757.9902Oct 2, 2025Nov 17, 2025Jan 3, 2026Feb 18, 2026Apr 6, 2026May 22, 2026Jul 8, 2026
Updated 3mo ago

Evaluation results

MethodLinks
DuplexPOFull Duplex=true2026.0775.3
Baichuan-AudioFull Duplex=false2026.0774
SALMONN-omniFull Duplex=true2026.0773.6
SFT BaselineFull Duplex=true2026.0772
STITCH-RFull Duplex=false2026.0770
Qwen2-AudioFull Duplex=false2026.0769.7
Kimi-AudioFull Duplex=false2026.0768.3
GLM-4-VoiceFull Duplex=false2026.0765.7
Freeze-OmniFull Duplex=true2026.0756.2
MoshiFull Duplex=true2026.0754.5
SALM-DuplexFull Duplex=true2026.0751.3
GLM-4-VoiceModality=S→S, # Params=9B, Full-duplex=✗2025.100.507
CT-Duplex w/ thkModality=S→S, # Params=1.7B, Full-duplex=✓2025.100.314
CT-Duplex w/o thkModality=S→S, # Params=1.7B, Full-duplex=✓2025.100.304
SpectronModality=S→T, # Params=1B, Full-duplex=✗2025.100.219
SpeechGPTModality=S→T, # Params=7B, Full-duplex=✗2025.100.216
MoshiModality=S→S, # Params=7B, Full-duplex=✓2025.100.21
SALM-Duplex*Modality=S→S, # Params=1.5B, Full-duplex=✓2025.100.15
TWISTModality=S→S, # Params=7B, Full-duplex=✗2025.100.04