Science Question Answering on ScienceQA SQA-I (test)
72.3AccuracyMAGIC
Evaluation Results
| Method | Links | |
|---|---|---|
| MAGICTraining Data Fraction=20%2026.05 | 72.3 | |
| ICONSTraining Data Fraction=20%2026.05 | 70.8 | |
| COIDOTraining Data Fraction=20%2026.05 | 69.4 | |
| D2-PruningTraining Data Fraction=20%2026.05 | 69.3 | |
| COINCIDETraining Data Fraction=20%2026.05 | 69.2 | |
| RandomTraining Data Fraction=20%2026.05 | 68.5 | |
| FullTraining Data Fraction=100%2026.05 | 68.4 | |
| RDSTraining Data Fraction=20%2026.05 | 68 | |
| Self-SepTraining Data Fraction=20%2026.05 | 67.8 | |
| SemDeDupTraining Data Fraction=20%2026.05 | 65.8 | |
| EL2NTraining Data Fraction=20%2026.05 | 65.5 | |
| PerplexityTraining Data Fraction=20%2026.05 | 65.1 | |
| CLIP-ScoreTraining Data Fraction=20%2026.05 | 65 | |
| Self-FilterTraining Data Fraction=20%2026.05 | 61.4 |