List your company
ResearchFormerly WizWand

Question Answering on PIQA (Attack Robustness Evaluation)

77.31Accuracy (Baseline)Hymba-1.5b
66.618869.394472.1774.9456Dec 14, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Hymba-1.5bBit-Flips=2, Attack=COBRA2025.1277.312.67
Mamba2-2.7bBit-Flips=9, Attack=COBRA2025.1274.8617.33
Mamba-2.8bBit-Flips=1, Attack=COBRA2025.1274.4852
Quamba-2.8b-w8a8Bit-Flips=1, Attack=COBRA2025.1273.990
Mamba-1.4bBit-Flips=1, Attack=COBRA2025.1273.3418
Quamba-2.8b-w4a16Bit-Flips=1, Attack=COBRA2025.1273.2925.33
Quamba-1.4b-w4a16Bit-Flips=1, Attack=COBRA2025.1272.476
Mamba2-1.3bBit-Flips=5, Attack=COBRA2025.1272.250
Quamba-1.4b-w8a8Bit-Flips=4, Attack=COBRA2025.1271.7649.33
Mamba2-370mBit-Flips=4, Attack=COBRA2025.1268.7724
Mamba-370mBit-Flips=4, Attack=COBRA2025.1267.0344.66