Open-domain dialogue red teaming on ConvAI2 filtered (test)
16.9RSRBRT (e+r)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BRT (e+r)Target model=GODEL-large, Query limit=20,0002023.05 | 16.9 | 0.353 | |
| BRT (s+r)Target model=GODEL-large, Query limit=20,0002023.05 | 13 | 0.373 | |
| SLSurrogate model=OPT-1.3B, Target model=GODEL-large, Query limit=20,0002023.05 | 5.4 | 0.52 | |
| Offensive Top-NQTarget model=GODEL-large, Query limit=20,0002023.05 | 5.1 | 0.377 | |
| SFSSurrogate model=OPT-1.3B, Target model=GODEL-large, Query limit=20,0002023.05 | 3.7 | 0.448 | |
| SFSSurrogate model=Bloom, Target model=GODEL-large, Query limit=20,0002023.05 | 3.6 | 0.447 | |
| RandTarget model=GODEL-large, Query limit=20,0002023.05 | 1.5 | 0.368 |