Abstention Trigger on Tool selection benchmark
0.88Certified Upper Bound (pu)Anomaly mon.
Evaluation results
| Method | Links | |
|---|---|---|
| Anomaly mon.Mitigation=Anomaly mon., Selector model=Llama-3.1, Generator model=Gemma-32025.10 | 0.88 | |
| SecAlignMitigation=SecAlign, Selector model=Llama-3.1, Generator model=Gemma-32025.10 | 0.84 | |
| StruQMitigation=StruQ, Selector model=Llama-3.1, Generator model=Gemma-32025.10 | 0.79 | |
| PerplexityMitigation=Perplexity, Selector model=Llama-3.1, Generator model=Gemma-32025.10 | 0.75 | |
| Defended retr.Mitigation=Defended retr., Selector model=Llama-3.1, Generator model=Gemma-32025.10 | 0.74 | |
| NoneMitigation=None, Selector model=Llama-3.1, Generator model=Gemma-32025.10 | 0.73 |