Question Answering on TyDi QA Gold Passage
73.8Arabic F1PaLM 2-S
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PaLM 2-SPrompting=1-shot, Evaluation Setting=Gold Passage2023.05 | 73.8 | 75.4 | 73.4 | 71.9 | 79.5 | 71.4 | 59.1 | 79.7 | 75.7 | 73.3 | |
| PaLM 2-MPrompting=1-shot, Evaluation Setting=Gold Passage2023.05 | 73.5 | 72.9 | 73.4 | 71.7 | 80.2 | 72.3 | 58.6 | 81.8 | 75.5 | 73.3 | |
| PaLM 2-LPrompting=1-shot, Evaluation Setting=Gold Passage2023.05 | 72.8 | 73.3 | 72.4 | 71 | 81.5 | 73.3 | 58.1 | 82.5 | 77.3 | 73.6 | |
| PaLMPrompting=1-shot, Evaluation Setting=Gold Passage2023.05 | 67.2 | 74 | 69.3 | 68.1 | 75.7 | 70.6 | 57.6 | 77.3 | 68 | 69.8 |