Commonsense Question Answering on CommonsenseQA (CSQA) (val)
75.7AccuracyChatGPT + Self-consistent chain-of-thought
Evaluation results
| Method | Links | |
|---|---|---|
| ChatGPT + Self-consistent chain-of-thoughtZero-shot=true, Variant=gpt-3.5-turbo, Prompting Strategy=Self-consistent chain-of-thought2024.01 | 75.7 | |
| ChatGPT + Chain-of-thoughtZero-shot=true, Variant=gpt-3.5-turbo, Prompting Strategy=Chain-of-thought2024.01 | 75.5 | |
| ChatGPTZero-shot=true, Variant=gpt-3.5-turbo2024.01 | 74.5 | |
| DeBERTa-v3-L (MR)Zero-shot=true, CSKB=ATM10X2024.01 | 71.6 | |
| DeBERTa-v3-L (CANDLE Distilled)Zero-shot=true, CSKB=CANDLE2024.01 | 69.9 | |
| CAR-DeBERTa-v3-LZero-shot=true, CSKB=AbsATM2024.01 | 69.3 | |
| GPT 3.5Zero-shot=true, Variant=text-davinci-0032024.01 | 68.9 | |
| LLAMA2Zero-shot=true, Model Scale=13B2024.01 | 67.3 | |
| CAR-DeBERTa-v3-LZero-shot=true, CSKB=ATOMIC2024.01 | 67.2 | |
| DeBERTa-v3-L (MR)Zero-shot=true, CSKB=ATOMIC2024.01 | 67 | |
| STL-AdapterZero-shot=true, CSKB=ATOMIC2024.01 | 66.5 | |
| VERA-T5-xxl (CANDLE Distilled)Zero-shot=true, CSKB=CANDLE2024.01 | 64.7 | |
| VERA-T5-xxlZero-shot=true, CSKB=AbsATM2024.01 | 63 | |
| VERA-T5-xxlZero-shot=true, CSKB=ATOMIC2024.01 | 61.7 | |
| Mistral-v0.1Zero-shot=true, Model Scale=7B2024.01 | 59.6 | |
| VERA-T5-xxlZero-shot=true, CSKB=ATM10X2024.01 | 59.5 | |
| LLAMA2Zero-shot=true, Model Scale=7B2024.01 | 57.8 | |
| ROBERTa-LZero-shot=true2024.01 | 45 | |
| MICOZero-shot=true, CSKB=ATOMIC2024.01 | 44.2 | |
| GPT-4Zero-shot=true, Variant=gpt-42024.01 | 43 | |
| SMLMZero-shot=true, CSKB=*2024.01 | 38.8 | |
| Self-talkZero-shot=true2024.01 | 32.4 | |
| DeBERTa-v3-LZero-shot=true2024.01 | 25.4 |