Reading Comprehension on RACE (Vanilla Accuracy and AbsAcc)
83.36Vanilla AccuracyGPT-3.5
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-3.5Size=>20B2024.03 | 83.36 | 66.79 | |
| MeanLearnSize=7B2024.03 | 77.15 | 57.1 | |
| MeanLearnSize=8B2024.03 | 77.02 | 55.09 | |
| LLaMA-3Size=8B2024.03 | 76.75 | 55.61 | |
| PaLM-2Size=>20B2024.03 | 75.82 | 61.54 | |
| Orca-2Size=7B2024.03 | 73.32 | 50.9 | |
| MeanLearnSize=13B2024.03 | 70.24 | 47.65 | |
| Orca-2Size=13B2024.03 | 66.86 | 42.12 | |
| VicunaSize=7B2024.03 | 65.75 | 38.68 | |
| VicunaSize=13B2024.03 | 63.54 | 36.5 | |
| WizardLMSize=13B2024.03 | 63.54 | 28.59 | |
| LLaMA-2Size=13B2024.03 | 59.46 | 32.17 | |
| LLaMA-2Size=7B2024.03 | 38.85 | 14.08 | |
| WizardLMSize=7B2024.03 | 22.11 | 5.57 |