Commonsense Question Answering on OpenBookQA
44AccuracyMistral-7B
Evaluation results
| Method | Links | |
|---|---|---|
| Mistral-7BRatio=0%, Evaluation Protocol=zero-shot2026.03 | 44 | |
| SoLARatio=20%, Evaluation Protocol=zero-shot2026.03 | 39.2 | |
| SoLARatio=30%, Evaluation Protocol=zero-shot2026.03 | 37.6 | |
| FLAPRatio=20%, Evaluation Protocol=zero-shot2026.03 | 36.8 | |
| SVD-LLMRatio=20%, Evaluation Protocol=zero-shot2026.03 | 36.6 | |
| FLAPRatio=30%, Evaluation Protocol=zero-shot2026.03 | 35.8 | |
| SVD-LLMRatio=30%, Evaluation Protocol=zero-shot2026.03 | 34.2 | |
| SliceGPTRatio=20%, Evaluation Protocol=zero-shot2026.03 | 32 | |
| SliceGPTRatio=30%, Evaluation Protocol=zero-shot2026.03 | 26.8 |