Commonsense Question Answering on QASC
72.8AccuracySCORE (GPT-4 Verifier)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SCORE (GPT-4 Verifier)Base LM=Gemma-7B-it, Verifier=gpt-4, Refiner=SCORE (fine-tuned)2024.04 | 72.8 | 89.9 | |
| SCORE (GPT-4 Verifier)Base LM=LLaMA-2-13B-chat, Verifier=gpt-4, Refiner=SCORE (fine-tuned)2024.04 | 68.1 | 85.9 | |
| Few-shot promptingBase LM=LLaMA-2-13B-chat2024.04 | 65.9 | — | |
| Few-shot promptingBase LM=Gemma-7B-it2024.04 | 65 | — |