LLM Alignment on Alpaca, BeaverTails, and TruthfulQA (test)
97.1Win RateAlignX
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AlignXStrategy=Fine-Tuning + MoCaE, Backbone=DeepSeek-7B2026.02 | 97.1 | 27.95 | 93.25 | 54.13 | |
| TrinityXStrategy=Fine-Tuning + MoCaE, Backbone=LLaMA-2-7B2026.02 | 96.75 | 30.03 | 98.66 | 55.12 | |
| TrinityXStrategy=MoCaE Only, Backbone=LLaMA-2-7B2026.02 | 93.33 | 23.17 | 75 | 48.38 | |
| AlignXStrategy=Fine-Tuning + MoCaE, Backbone=LLaMA-2-7B2026.02 | 91.15 | 29.35 | 91.1 | 51.3 | |
| AlignXStrategy=Fine-Tuning + MoCaE, Backbone=Mistral-7B2026.02 | 88.4 | 28.9 | 87.85 | 49.78 | |
| MoCaEStrategy=MoCaE Only, Backbone=DeepSeek-7B2026.02 | 86.55 | 23.15 | 79.4 | 47.6 | |
| MoCaEStrategy=MoCaE Only, Backbone=LLaMA-2-7B2026.02 | 85.8 | 24.7 | 68.25 | 43.78 | |
| AlignXStrategy=Fine-Tuning + MoCaE, Backbone=Gemma-7B2026.02 | 85.65 | 30.1 | 84.6 | 46.72 | |
| MoCaEStrategy=MoCaE Only, Backbone=Mistral-7B2026.02 | 83.9 | 25.05 | 66.1 | 41.65 | |
| MoCaEStrategy=MoCaE Only, Backbone=Gemma-7B2026.02 | 81.75 | 25.8 | 63.35 | 39.77 | |
| H3FusionStrategy=Fine-Tuning + MoCaE, Backbone=LLaMA-2-7B2026.02 | 80 | 28.8 | 41.73 | 30.98 | |
| H3FusionStrategy=MoCaE Only, Backbone=LLaMA-2-7B2026.02 | 72 | 30.4 | 39.85 | 27.15 |