Synonym Substitution Robustness on ELI5 prompts 32-bit payload Llama3.1-8B (test)
70.7Bit Accuracy (10% Substitution)Ours+
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Ours+Payload=32-bit, Backbone=LLAMA3.1-8B, Type=Stateful Encoder2026.05 | 70.7 | 64.2 | 59.1 | 56.2 | 54.3 | |
| MC2MarkPayload=32-bit, Backbone=LLAMA3.1-8B2026.05 | 67.1 | 61.9 | 57.8 | 55.1 | 53.6 | |
| BiMarkPayload=32-bit, Backbone=LLAMA3.1-8B2026.05 | 66.6 | 61.6 | 58 | 55.6 | 53.6 | |
| MPACPayload=32-bit, Backbone=LLAMA3.1-8B2026.05 | 61.2 | 57.5 | 55.5 | 53.2 | 52.4 | |
| StealthInkPayload=32-bit, Backbone=LLAMA3.1-8B2026.05 | 60.9 | 57.2 | 54.9 | 53.7 | 52.6 | |
| MirrorMarkPayload=32-bit, Backbone=LLAMA3.1-8B2026.05 | 54.4 | 52.3 | 50.9 | 51.1 | 50.5 | |
| RSBHPayload=32-bit, Backbone=LLAMA3.1-8B2026.05 | 50.9 | 50.6 | 50.3 | 49.9 | 50.1 |