Overrefusal Evaluation on Over-refusal Evaluation Suite (OB, FB)
9.9Overrefusal Rate (OB)WaltzRL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| WaltzRLMethod Identity=Method 72025.10 | 9.9 | 5.4 | 7.6 | |
| Single-model RLDescription=Traditional single-model RL without feedback agent2025.10 | 11.9 | 5.2 | 8.6 | |
| Inference-time collaborationBackbone=Llama-3.1-8B-Instruct, Training=None2025.10 | 18.3 | 7 | 12.7 | |
| Single-model RL + SafeguardSafeguard=Llama Guard 42025.10 | 20.7 | 9.2 | 14.9 | |
| Oracle label-converted feedbackFeedback Source=Ground truth labels2025.10 | 28.2 | 5 | 16.6 | |
| Baseline responseBackbone=Llama-3.1-8B-Instruct, Training=None2025.10 | 45.3 | 6 | 25.7 | |
| Baseline response + SafeguardBackbone=Llama-3.1-8B-Instruct, Safeguard=Llama Guard 42025.10 | 48.7 | 11 | 29.8 |