Mathematical Reasoning on GSM8K (test) (Accuracy, # FLIP, Targeted Attack)
85AccuracyTFL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TFLModel Name=QWEN3-8B, Precision=BF162026.02 | 85 | 3 | — | |
| TFLModel Name=QWEN3-8B, Precision=INT82026.02 | 81 | 4 | — | |
| PrisonBreakModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=FP42026.02 | 80 | 50 | — | |
| PrisonBreakModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=INT82026.02 | 77 | 50 | — | |
| TFLModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=BF162026.02 | 75 | 14 | — | |
| PrisonBreakModel Name=QWEN3-8B, Precision=INT82026.02 | 72 | 50 | — | |
| PrisonBreakModel Name=QWEN3-8B, Precision=FP42026.02 | 70 | 50 | — | |
| TFLModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=BF162026.02 | 68 | 7 | — | |
| TFLModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=INT82026.02 | 65 | 13 | — | |
| TFLModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=INT82026.02 | 65 | 7 | — | |
| PrisonBreakModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=FP42026.02 | 60 | 50 | — | |
| PrisonBreakModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=INT82026.02 | 59 | 50 | — | |
| SilentStrikerModel Name=QWEN3-8B, Precision=FP42026.02 | 10 | 50 | — | |
| SilentStrikerModel Name=QWEN3-8B, Precision=INT82026.02 | 9 | 50 | — | |
| SilentStrikerModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=FP42026.02 | 8 | 50 | — | |
| SilentStrikerModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=INT82026.02 | 4 | 50 | — | |
| SBFAModel Name=QWEN3-8B, Precision=BF162026.02 | 2 | 1 | — | |
| GenBFAModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=INT82026.02 | 0 | 50 | — | |
| GenBFAModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=FP42026.02 | 0 | 50 | — | |
| SBFAModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=INT82026.02 | 0 | 1 | — | |
| SBFAModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=BF162026.02 | 0 | 1 | — | |
| GenBFAModel Name=QWEN3-8B, Precision=INT82026.02 | 0 | 50 | — | |
| GenBFAModel Name=QWEN3-8B, Precision=FP42026.02 | 0 | 50 | — | |
| SBFAModel Name=QWEN3-8B, Precision=INT82026.02 | 0 | 1 | — | |
| GenBFAModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=INT82026.02 | 0 | 50 | — | |
| GenBFAModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=FP42026.02 | 0 | 50 | — | |
| SilentStrikerModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=INT82026.02 | 0 | 50 | — | |
| SilentStrikerModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=FP42026.02 | 0 | 50 | — | |
| SBFAModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=BF162026.02 | 0 | 2 | — |