ResearchBenchmarksSymbolic Reasoning on Last Letter Concatenation OOD: 4 (test)Follow63AccuracyPaLM 540B-2.5214.4931.548.51Dec 16, 2022Evaluation ResultsMethodMethodLinksAccuracyPaLM 540BMethod=CoT 8-shotMethod=CoT 8-shot2022.1263T5 XXLMethod=BaselineMethod=Baseline2022.120T5 XXLMethod=CoT FinetunedMethod=CoT Finetuned2022.120