List your company
ResearchFormerly WizWand

Question Answering on Web Questions

43.5EMPaLM 540B
-0.1811.1622.533.84Apr 5, 2022Nov 3, 2022Jun 4, 2023Jan 3, 2024Aug 2, 2024Mar 3, 2025Oct 2, 2025
Updated 4mo ago

Evaluation results

MethodLinks
PaLM 540BEvaluation Protocol=Few-shot, Number of Shots=642022.0443.5
GPT-3 175BEvaluation Protocol=Few-shot, Number of Shots=642022.0441.1
Falcon-180Bprotocol=1-shot2023.1131.9
PaLM 2-Lprompting=1-shot2023.0528.2
PaLM-2 Lprotocol=1-shot2023.1128.2
PaLM 2-Mprompting=1-shot2023.0526.9
PaLM-2 Mprotocol=1-shot2023.1126.9
GPT-3 175BEvaluation Protocol=1-shot2022.0425.3
PaLMprompting=1-shot2023.0522.6
PaLMprotocol=1-shot2023.1122.6
PaLM 540BEvaluation Protocol=1-shot2022.0422.6
PaLM 2-Sprompting=1-shot2023.0521.8
PaLM-2 Sprotocol=1-shot2023.1121.8
GLaM 62B/64EEvaluation Protocol=0-shot2022.0419
GLM-4-VoiceModality=S→S, # Params=9B, Full-duplex=✗2025.1015.9
CT-Duplex w/ thkModality=S→S, # Params=1.7B, Full-duplex=✓2025.1013.3
CT-Duplex w/o thkModality=S→S, # Params=1.7B, Full-duplex=✓2025.1013.2
PaLM 540BEvaluation Protocol=0-shot2022.0410.6
MoshiModality=S→S, # Params=7B, Full-duplex=✓2025.109.2
SALM-Duplex*Modality=S→S, # Params=1.5B, Full-duplex=✓2025.106.7
SpeechGPTModality=S→T, # Params=7B, Full-duplex=✗2025.106.5
SpectronModality=S→T, # Params=1B, Full-duplex=✗2025.106.1
TWISTModality=S→S, # Params=7B, Full-duplex=✗2025.101.5