Overrefusal Evaluation on Fortress OR
97.6Helpfulness ScoreRECAP
Evaluation Results
| Method | Links | |
|---|---|---|
| RECAPBackbone=DSQwen-14B2025.10 | 97.6 | |
| SafeChainBackbone=DSQwen-14B2025.10 | 96.4 | |
| SFTBackbone=DSQwen-14B2025.10 | 96 | |
| OriginalBackbone=DSQwen-14B2025.10 | 95 | |
| DAPOBackbone=DSQwen-14B2025.10 | 95 | |
| STARBackbone=DSQwen-14B2025.10 | 93.2 | |
| RECAPBackbone=DSLlama-8B2025.10 | 91.8 | |
| OriginalBackbone=DSLlama-8B2025.10 | 90 | |
| STARBackbone=DSLlama-8B2025.10 | 86 | |
| SafeChainBackbone=DSLlama-8B2025.10 | 84.5 | |
| DAPOBackbone=DSLlama-8B2025.10 | 82.8 | |
| SFTBackbone=DSLlama-8B2025.10 | 82.4 |