Question Answering on MMLU (Domain Bias and Performance)
2.8Mu Bias (STEM)RSCB
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| RSCBModel=LLaMA2-13B2024.06 | 2.8 | 74.7 | 1.3 | 85.9 | 6.8 | 79.1 | 1.6 | 84.8 | 3.1 | 80.9 | |
| PIFModel=LLaMA2-7B2024.06 | 3.7 | 72.3 | 2.3 | 83.9 | 3.9 | 83.1 | 1.3 | 82.9 | 2.7 | 80.8 | |
| RSCBModel=LLaMA2-7B2024.06 | 3.8 | 71.8 | 3.4 | 83.1 | 5.3 | 81.8 | 2.9 | 81.6 | 3 | 78.8 | |
| PIFModel=LLaMA2-13B2024.06 | 4.8 | 74.5 | 2 | 85.1 | 2.9 | 80.9 | 2.6 | 84.2 | 3 | 81 | |
| SymbolModel=LLaMA2-13B2024.06 | 6.2 | 73.9 | 1.9 | 84.9 | 5.6 | 79.5 | 3.5 | 83.9 | 3.8 | 80.5 | |
| SCBModel=LLaMA2-7B2024.06 | 7.7 | 71.5 | 4.5 | 83 | 4.1 | 83.7 | 3.2 | 81.4 | 4.7 | 80.5 | |
| SCBModel=LLaMA2-13B2024.06 | 9.9 | 71.8 | 5.3 | 83.9 | 4.9 | 79.7 | 3.1 | 83.6 | 5.6 | 79.8 | |
| SymbolModel=LLaMA2-7B2024.06 | 10.3 | 70.9 | 6.8 | 81.8 | 8.2 | 81.3 | 8.1 | 80.2 | 7.7 | 78.9 |