ResearchBenchmarksSymbolic Reasoning on Last Letter Concatenation OOD: 3 (test)Follow94.8AccuracyPaLM 540B-3.79221.80447.472.996Dec 16, 2022Evaluation ResultsMethodMethodLinksAccuracyPaLM 540BMethod=CoT 8-shotMethod=CoT 8-shot2022.1294.8T5 XXLMethod=BaselineMethod=Baseline2022.120T5 XXLMethod=CoT FinetunedMethod=CoT Finetuned2022.120