Commonsense Reasoning on Com.
78.05Vanilla AccPaLM-2
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PaLM-2Size=>20B2024.03 | 78.05 | 69.34 | |
| MeanLearnSize=7B2024.03 | 76.59 | 71.17 | |
| GPT-3.5Size=>20B2024.03 | 74.8 | 65.74 | |
| LLaMA-3Size=8B2024.03 | 71.76 | 66.35 | |
| MeanLearnSize=8B2024.03 | 71.73 | 66.48 | |
| Orca-2Size=7B2024.03 | 71.58 | 64.02 | |
| MeanLearnSize=13B2024.03 | 69.75 | 61.04 | |
| Orca-2Size=13B2024.03 | 65.92 | 56.41 | |
| VicunaSize=7B2024.03 | 64.77 | 58.07 | |
| VicunaSize=13B2024.03 | 63.1 | 55.26 | |
| WizardLMSize=13B2024.03 | 63.1 | 55.73 | |
| LLaMA-2Size=13B2024.03 | 61 | 52.87 | |
| LLaMA-2Size=7B2024.03 | 55.37 | 47.42 | |
| WizardLMSize=7B2024.03 | 43.63 | 32.96 |