Embedding Inversion on QNLI (test)
0.2226ROUGE-LTransfer Attack
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Transfer AttackVictim Embedding Model=OpenAI text-embeddings-ada-002, Decoder=DialoGPT2024.06 | 0.2226 | 10.242 | 0.4772 | 0.4402 | |
| Transfer AttackEmbedding Model=OpenAI text-embeddings-ada-0022024.06 | 0.2071 | 18.692 | 0.4253 | 0.3987 | |
| Transfer AttackVictim Embedding Model=ST5, Decoder=DialoGPT2024.06 | 0.1985 | 11.808 | 0.4121 | 0.3963 | |
| Transfer AttackVictim Embedding Model=SBERT, Decoder=DialoGPT2024.06 | 0.1934 | 11.633 | 0.4886 | 0.428 | |
| Transfer AttackEmbedding Model=ST52024.06 | 0.1931 | 19.829 | 0.3946 | 0.3825 | |
| Transfer AttackEmbedding Model=SBERT2024.06 | 0.18 | 20.515 | 0.4445 | 0.3899 | |
| Direct AttackEmbedding Model=ST52024.06 | 0.1463 | 42.911 | 0.2226 | 0.2755 | |
| Direct AttackVictim Embedding Model=ST5, Decoder=DialoGPT2024.06 | 0.1463 | 42.911 | 0.2226 | 0.2755 | |
| Direct AttackEmbedding Model=OpenAI text-embeddings-ada-0022024.06 | 0.1433 | 40.822 | 0.2797 | 0.2984 | |
| Direct AttackVictim Embedding Model=OpenAI text-embeddings-ada-002, Decoder=DialoGPT2024.06 | 0.1433 | 40.822 | 0.2797 | 0.2984 | |
| Direct AttackEmbedding Model=SBERT2024.06 | 0.1264 | 27.127 | 0.3257 | 0.3194 | |
| Direct AttackVictim Embedding Model=SBERT, Decoder=DialoGPT2024.06 | 0.1264 | 27.127 | 0.3257 | 0.3194 |