Arithmetic Reasoning on ASDiv (5-fold cross val)
73.9AccuracyPaLM 540B (CoT 8-shot)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PaLM 540B (CoT 8-shot)Model=PaLM 540B, Finetuning Strategy=None (Zero-shot/Few-shot), Prompting Strategy=8-shot Chain-of-thought2022.12 | 73.9 | 72.6 | |
| T5 XXL (CoT Finetuned)Model=T5 XXL, Finetuning Strategy=CoT knowledge distillation, Prompting Strategy=Chain-of-thought2022.12 | 42.12 | 60.73 | |
| T5 XXL (Baseline)Model=T5 XXL, Finetuning Strategy=Finetuned on original target labels, Prompting Strategy=Direct2022.12 | 39.64 | — |