Question Answering on Xiezhi (test)
66.4Score (History)KaFT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| KaFTBackbone=LLaMA3-8B, Training Domain=History2025.05 | 66.4 | 66 | 67.6 | 66.67 | |
| KaFTBackbone=LLaMA3-8B, Training Domain=Law2025.05 | 66 | 65.6 | 61.2 | 64.27 | |
| Vanilla SFTBackbone=LLaMA3-8B, Training Domain=History2025.05 | 64.4 | 66 | 67.2 | 65.87 | |
| Vanilla SFTBackbone=LLaMA3-8B, Training Domain=Law2025.05 | 64.4 | 64.4 | 60.8 | 63.2 | |
| No-conflictBackbone=LLaMA3-8B, Training Domain=Law2025.05 | 61.6 | 64 | 60 | 61.87 | |
| No-conflictBackbone=LLaMA3-8B, Training Domain=History2025.05 | 60 | 66.8 | 65.2 | 64 | |
| KaFTBackbone=LLaMA3-8B, Training Domain=Engineering2025.05 | 58.8 | 67.2 | 56.8 | 60.93 | |
| Vanilla SFTBackbone=LLaMA3-8B, Training Domain=Engineering2025.05 | 57.6 | 65.2 | 56.8 | 59.87 | |
| Self-aligningBackbone=LLaMA3-8B, Training Domain=Law2025.05 | 57.6 | 64.4 | 58 | 60 | |
| Self-aligningBackbone=LLaMA3-8B, Training Domain=History2025.05 | 56.8 | 66 | 60.4 | 61.07 | |
| No-conflictBackbone=LLaMA3-8B, Training Domain=Engineering2025.05 | 56.8 | 65.2 | 56 | 59.33 | |
| Self-aligningBackbone=LLaMA3-8B, Training Domain=Engineering2025.05 | 52.8 | 63.6 | 55.2 | 57.2 | |
| BaseBackbone=LLaMA3-8B, Training Domain=History2025.05 | 49.6 | 59.2 | 51.6 | 53.47 | |
| BaseBackbone=LLaMA3-8B, Training Domain=Engineering2025.05 | 49.6 | 59.2 | 51.6 | 53.47 | |
| BaseBackbone=LLaMA3-8B, Training Domain=Law2025.05 | 49.6 | 59.2 | 51.6 | 53.47 |