Question Answering on TyDi QA No-context
42.6F1 (Arabic)PaLM 2-L
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PaLM 2-LPrompting=1-shot, Evaluation Setting=No-context2023.05 | 42.6 | 41.6 | 43.7 | 45.5 | 46.4 | 46.9 | 33.5 | 50.3 | 12.2 | 40.3 | |
| PaLM 2-MPrompting=1-shot, Evaluation Setting=No-context2023.05 | 40.2 | 36.7 | 42 | 38.8 | 41.3 | 41.7 | 29.2 | 45.1 | 10.5 | 36.2 | |
| PaLM 2-SPrompting=1-shot, Evaluation Setting=No-context2023.05 | 36.4 | 29.5 | 38 | 36.8 | 37.7 | 38.7 | 26 | 39.9 | 9.2 | 32.5 | |
| PaLMPrompting=1-shot, Evaluation Setting=No-context2023.05 | 34.5 | 27.6 | 38.3 | 38.3 | 35.5 | 35 | 24.6 | 39.7 | 9.6 | 31.5 |