Reading Comprehension on DROP (test) (F1, FLIP, Attack)
76F1 ScoreTFL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TFLModel Name=QWEN3-8B, Precision=INT82026.02 | 76 | 4 | — | |
| TFLModel Name=QWEN3-8B, Precision=BF162026.02 | 71 | 3 | — | |
| TFLModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=BF162026.02 | 67 | 7 | — | |
| PrisonBreakModel Name=QWEN3-8B, Precision=INT82026.02 | 66 | 50 | — | |
| TFLModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=INT82026.02 | 62 | 7 | — | |
| PrisonBreakModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=FP42026.02 | 61 | 50 | — | |
| PrisonBreakModel Name=QWEN3-8B, Precision=FP42026.02 | 60 | 50 | — | |
| PrisonBreakModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=INT82026.02 | 58 | 50 | — | |
| TFLModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=INT82026.02 | 56 | 13 | — | |
| TFLModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=BF162026.02 | 54 | 14 | — | |
| PrisonBreakModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=FP42026.02 | 46 | 50 | — | |
| PrisonBreakModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=INT82026.02 | 42 | 50 | — | |
| SilentStrikerModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=FP42026.02 | 5 | 50 | — | |
| SilentStrikerModel Name=QWEN3-8B, Precision=INT82026.02 | 3 | 50 | — | |
| SilentStrikerModel Name=QWEN3-8B, Precision=FP42026.02 | 3 | 50 | — | |
| SilentStrikerModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=FP42026.02 | 2 | 50 | — | |
| SBFAModel Name=QWEN3-8B, Precision=INT82026.02 | 1 | 1 | — | |
| GenBFAModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=INT82026.02 | 0 | 50 | — | |
| GenBFAModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=FP42026.02 | 0 | 50 | — | |
| SilentStrikerModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=INT82026.02 | 0 | 50 | — | |
| SBFAModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=INT82026.02 | 0 | 1 | — | |
| SBFAModel Name=LLAMA-3.1-8B-INSTRUCT, Precision=BF162026.02 | 0 | 1 | — | |
| GenBFAModel Name=QWEN3-8B, Precision=INT82026.02 | 0 | 50 | — | |
| GenBFAModel Name=QWEN3-8B, Precision=FP42026.02 | 0 | 50 | — | |
| SBFAModel Name=QWEN3-8B, Precision=BF162026.02 | 0 | 1 | — | |
| GenBFAModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=INT82026.02 | 0 | 50 | — | |
| GenBFAModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=FP42026.02 | 0 | 50 | — | |
| SilentStrikerModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=INT82026.02 | 0 | 50 | — | |
| SBFAModel Name=DEEPSEEK-R1-DISTILL-QWEN-14B, Precision=BF162026.02 | 0 | 2 | — |