Embedding Inversion on IMDB (test)
19.91RougeLTransfer Attack
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Transfer AttackVictim Embedding Model=OpenAI text-embeddings-ada-002, Decoder=DialoGPT2024.06 | 19.91 | 12.953 | 42.97 | 45.28 | |
| Transfer AttackEmbedding Model=OpenAI text-embeddings-ada-0022024.06 | 18.08 | 25.756 | 41.57 | 45.04 | |
| Transfer AttackVictim Embedding Model=SBERT, Decoder=DialoGPT2024.06 | 16.89 | 14.505 | 44.67 | 44.75 | |
| Transfer AttackEmbedding Model=SBERT2024.06 | 16.85 | 27.819 | 43.33 | 37.47 | |
| Transfer AttackVictim Embedding Model=ST5, Decoder=DialoGPT2024.06 | 15.71 | 14.839 | 38.66 | 42.95 | |
| Transfer AttackEmbedding Model=ST52024.06 | 15.63 | 30.311 | 37.92 | 43.98 | |
| Direct AttackEmbedding Model=SBERT2024.06 | 11.37 | 34.805 | 28.91 | 39.23 | |
| Direct AttackVictim Embedding Model=SBERT, Decoder=DialoGPT2024.06 | 11.37 | 34.805 | 28.91 | 39.23 | |
| Direct AttackEmbedding Model=OpenAI text-embeddings-ada-0022024.06 | 11.33 | 20.549 | 26.92 | 38.18 | |
| Direct AttackVictim Embedding Model=OpenAI text-embeddings-ada-002, Decoder=DialoGPT2024.06 | 11.33 | 20.549 | 26.92 | 38.18 | |
| Direct AttackEmbedding Model=ST52024.06 | 11.03 | 24.939 | 26.78 | 39.09 | |
| Direct AttackVictim Embedding Model=ST5, Decoder=DialoGPT2024.06 | 11.03 | 24.939 | 26.78 | 39.09 |