System Prompt Extraction on System Prompt Extraction In-domain ShareGPT
91Exact Match ScoreRogueMerge
Evaluation results
| Method | Links | |
|---|---|---|
| RogueMergeMerging Method=TIES, Number of Queries=52026.06 | 91 | |
| RogueMergeMerging Method=AIM, Number of Queries=52026.06 | 90 | |
| RogueMergeMerging Method=TA, Number of Queries=52026.06 | 87 | |
| RogueMergeMerging Method=DeLLA, Number of Queries=52026.06 | 87 | |
| LoBAM*Merging Method=TIES, Number of Queries=52026.06 | 79 | |
| LoBAM*Merging Method=DeLLA, Number of Queries=52026.06 | 68 | |
| LoBAM*Merging Method=AIM, Number of Queries=52026.06 | 68 | |
| LoBAM*Merging Method=TA, Number of Queries=52026.06 | 60 | |
| MergeHijacking (MH*)Merging Method=AIM, Number of Queries=52026.06 | 36 | |
| MergeHijacking (MH*)Merging Method=TIES, Number of Queries=52026.06 | 34 | |
| MergeHijacking (MH*)Merging Method=DeLLA, Number of Queries=52026.06 | 34 | |
| SFTMerging Method=AIM, Number of Queries=52026.06 | 33 | |
| SFTMerging Method=TA, Number of Queries=52026.06 | 32 | |
| SFTMerging Method=TIES, Number of Queries=52026.06 | 32 | |
| MergeHijacking (MH*)Merging Method=TA, Number of Queries=52026.06 | 31 | |
| SFTMerging Method=DeLLA, Number of Queries=52026.06 | 31 | |
| CleanMerging Method=TA, Number of Queries=52026.06 | 21 | |
| CleanMerging Method=DeLLA, Number of Queries=52026.06 | 21 | |
| CleanMerging Method=TIES, Number of Queries=52026.06 | 20 | |
| CleanMerging Method=AIM, Number of Queries=52026.06 | 20 |