Question Answering on Web Questions
43.5EMPaLM 540B
Evaluation Results
| Method | Links | |
|---|---|---|
| PaLM 540BEvaluation Protocol=Few-shot, Number of Shots=642022.04 | 43.5 | |
| GPT-3 175BEvaluation Protocol=Few-shot, Number of Shots=642022.04 | 41.1 | |
| Falcon-180Bprotocol=1-shot2023.11 | 31.9 | |
| PaLM 2-Lprompting=1-shot2023.05 | 28.2 | |
| PaLM-2 Lprotocol=1-shot2023.11 | 28.2 | |
| PaLM 2-Mprompting=1-shot2023.05 | 26.9 | |
| PaLM-2 Mprotocol=1-shot2023.11 | 26.9 | |
| GPT-3 175BEvaluation Protocol=1-shot2022.04 | 25.3 | |
| PaLMprompting=1-shot2023.05 | 22.6 | |
| PaLMprotocol=1-shot2023.11 | 22.6 | |
| PaLM 540BEvaluation Protocol=1-shot2022.04 | 22.6 | |
| PaLM 2-Sprompting=1-shot2023.05 | 21.8 | |
| PaLM-2 Sprotocol=1-shot2023.11 | 21.8 | |
| GLaM 62B/64EEvaluation Protocol=0-shot2022.04 | 19 | |
| GLM-4-VoiceModality=S→S, # Params=9B, Full-duplex=✗2025.10 | 15.9 | |
| CT-Duplex w/ thkModality=S→S, # Params=1.7B, Full-duplex=✓2025.10 | 13.3 | |
| CT-Duplex w/o thkModality=S→S, # Params=1.7B, Full-duplex=✓2025.10 | 13.2 | |
| PaLM 540BEvaluation Protocol=0-shot2022.04 | 10.6 | |
| MoshiModality=S→S, # Params=7B, Full-duplex=✓2025.10 | 9.2 | |
| SALM-Duplex*Modality=S→S, # Params=1.5B, Full-duplex=✓2025.10 | 6.7 | |
| SpeechGPTModality=S→T, # Params=7B, Full-duplex=✗2025.10 | 6.5 | |
| SpectronModality=S→T, # Params=1B, Full-duplex=✗2025.10 | 6.1 | |
| TWISTModality=S→S, # Params=7B, Full-duplex=✗2025.10 | 1.5 |