System Prompt Extraction on System Prompt Extraction Out-of-domain SystemCheck and ChatGPT-Prompts
93.5Exact Match ScoreRogueMerge
Evaluation Results
| Method | Links | |
|---|---|---|
| RogueMergeMerging Method=TA, Number of Queries=52026.06 | 93.5 | |
| RogueMergeMerging Method=TIES, Number of Queries=52026.06 | 93.5 | |
| RogueMergeMerging Method=AIM, Number of Queries=52026.06 | 93 | |
| RogueMergeMerging Method=DeLLA, Number of Queries=52026.06 | 91.5 | |
| LoBAM*Merging Method=TIES, Number of Queries=52026.06 | 76 | |
| LoBAM*Merging Method=AIM, Number of Queries=52026.06 | 72.5 | |
| LoBAM*Merging Method=DeLLA, Number of Queries=52026.06 | 72 | |
| LoBAM*Merging Method=TA, Number of Queries=52026.06 | 67 | |
| MergeHijacking (MH*)Merging Method=TIES, Number of Queries=52026.06 | 45.5 | |
| SFTMerging Method=TIES, Number of Queries=52026.06 | 45.5 | |
| SFTMerging Method=AIM, Number of Queries=52026.06 | 44 | |
| MergeHijacking (MH*)Merging Method=AIM, Number of Queries=52026.06 | 42.5 | |
| MergeHijacking (MH*)Merging Method=DeLLA, Number of Queries=52026.06 | 39.5 | |
| SFTMerging Method=TA, Number of Queries=52026.06 | 38 | |
| SFTMerging Method=DeLLA, Number of Queries=52026.06 | 36.5 | |
| MergeHijacking (MH*)Merging Method=TA, Number of Queries=52026.06 | 36 | |
| CleanMerging Method=TIES, Number of Queries=52026.06 | 31.5 | |
| CleanMerging Method=AIM, Number of Queries=52026.06 | 26 | |
| CleanMerging Method=TA, Number of Queries=52026.06 | 25.5 | |
| CleanMerging Method=DeLLA, Number of Queries=52026.06 | 22 |