Language Modeling on WikiText (Adversarial Robustness Evaluation)
1.7PPL Change (%)LoRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| LoRABackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+Fin2026.04 | 1.7 | — | — | |
| LoRABackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+PG2026.04 | 5.7 | — | — | |
| LoRABackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+Med2026.04 | 10.8 | — | — | |
| LoRABackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+MdQ2026.04 | 10.9 | — | — | |
| LoRABackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+LB2026.04 | 15.3 | — | — | |
| GAINBackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+HS2026.04 | 22.1 | — | — | |
| GAINBackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+SST2026.04 | 22.4 | — | — | |
| GAINBackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+LB2026.04 | 22.6 | — | — | |
| GAINBackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+MdQ2026.04 | 22.7 | — | — | |
| GAINBackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+PG2026.04 | 22.9 | — | — | |
| GAINBackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+WT2026.04 | 23.1 | — | — | |
| GAINBackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+Fin2026.04 | 23.1 | — | — | |
| GAINBackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+Med2026.04 | 23.2 | — | — | |
| LoRABackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+WT2026.04 | 30.9 | — | — | |
| LoRABackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+SST2026.04 | 43.6 | — | — | |
| LoRABackbone=Mistral-7B, Learning Rate=10⁻³, Tokens per domain=200K, Training Stage=+HS2026.04 | 44.4 | — | — | |
| Hymba-1.5bBit-Flips=2, Attack=COBRA2025.12 | — | 14.4 | 17,620 | |
| Mamba-1.4bBit-Flips=1, Attack=COBRA2025.12 | — | 18.94 | 3,750,000 | |
| Mamba-2.8bBit-Flips=1, Attack=COBRA2025.12 | — | 16.31 | 123,000 | |
| Mamba-370mBit-Flips=4, Attack=COBRA2025.12 | — | 24.87 | 126,000,000,000 | |
| Mamba2-1.3bBit-Flips=5, Attack=COBRA2025.12 | — | 18.76 | 2,410,000 | |
| Mamba2-2.7bBit-Flips=9, Attack=COBRA2025.12 | — | 16.59 | 24,800 | |
| Mamba2-370mBit-Flips=4, Attack=COBRA2025.12 | — | 26.69 | 24,800 | |
| Quamba-1.4b-w4a16Bit-Flips=1, Attack=COBRA2025.12 | — | 23.62 | 606.673 | |
| Quamba-1.4b-w8a8Bit-Flips=4, Attack=COBRA2025.12 | — | 22.193 | 50.08 | |
| Quamba-2.8b-w4a16Bit-Flips=1, Attack=COBRA2025.12 | — | 9.91 | 765,000 | |
| Quamba-2.8b-w8a8Bit-Flips=1, Attack=COBRA2025.12 | — | 19.53 | 12,600,000,000 |