Embedding Inversion on AGNEWS (test)
12.71RougeLTransfer Attack
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Transfer AttackVictim Embedding Model=OpenAI text-embeddings-ada-002, Decoder=DialoGPT2024.06 | 12.71 | 31.159 | 0.4301 | 0.4057 | |
| Transfer AttackVictim Embedding Model=SBERT, Decoder=DialoGPT2024.06 | 10.67 | 36.793 | 0.411 | 0.3839 | |
| Transfer AttackEmbedding Model=OpenAI text-embeddings-ada-0022024.06 | 10.66 | 101.04 | 0.3655 | 0.3618 | |
| Transfer AttackVictim Embedding Model=ST5, Decoder=DialoGPT2024.06 | 10.42 | 40.809 | 0.3697 | 0.3706 | |
| Transfer AttackEmbedding Model=SBERT2024.06 | 9.84 | 103.4 | 0.3589 | 0.3497 | |
| Transfer AttackEmbedding Model=ST52024.06 | 9.38 | 128.26 | 0.3256 | 0.346 | |
| Direct AttackEmbedding Model=OpenAI text-embeddings-ada-0022024.06 | 6.12 | 66.383 | 0.1162 | 0.2979 | |
| Direct AttackVictim Embedding Model=OpenAI text-embeddings-ada-002, Decoder=DialoGPT2024.06 | 6.12 | 66.383 | 0.1162 | 0.2979 | |
| Direct AttackEmbedding Model=ST52024.06 | 5.78 | 74.085 | 0.098 | 0.2905 | |
| Direct AttackVictim Embedding Model=ST5, Decoder=DialoGPT2024.06 | 5.78 | 74.085 | 0.098 | 0.2905 | |
| Direct AttackEmbedding Model=SBERT2024.06 | 5.38 | 286.16 | 0.1317 | 0.2742 | |
| Direct AttackVictim Embedding Model=SBERT, Decoder=DialoGPT2024.06 | 5.38 | 286.16 | 0.1317 | 0.2742 |