Adversarial Retrieval on Python Alpaca A1
100Hit Rate@1RAG-PULL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RAG-PULLModel=SFR-2B, Attack Mode=Both, Dim=23042025.10 | 100 | 100 | 100 | |
| RAG-PULLModel=OpenAI Ada-002, Model Source=API, Attack Mode=Q2T, Dim=15362025.10 | 38.28 | 77.73 | 89.45 | |
| RAG-PULLModel=Perplexity 4B, Model Source=API, Attack Mode=Q2T, Dim=25602025.10 | 10.04 | 31.33 | 46.59 | |
| RAG-PULLModel=jina-1.5B, Model Source=Local, Attack Mode=Q2T, Dim=15362025.10 | 4.38 | 12.75 | 23.51 | |
| RAG-PULLModel=SFR-2B, Attack Mode=Q2T, Dim=23042025.10 | 3.91 | 14.45 | 23.44 | |
| RAG-PULLModel=Codestral Embed, Model Source=API, Attack Mode=Q2T, Dim=15362025.10 | 1.82 | 3.18 | 3.18 | |
| RAG-PULLModel=OpenAI Small, Model Source=API, Attack Mode=Q2T, Dim=15362025.10 | 0.78 | 4.3 | 8.98 | |
| RAG-PULLModel=Gemini Embed, Model Source=API, Attack Mode=Q2T, Dim=30722025.10 | 0.39 | 0.78 | 0.78 | |
| RAG-PULLModel=SFR-2B, Attack Mode=T2Q, Dim=23042025.10 | 0 | 12.11 | 17.19 | |
| RAG-PULLModel=SFR-400M, Model Source=Local, Attack Mode=Q2T, Dim=10242025.10 | 0 | 0 | 0 | |
| RAG-PULLModel=jina-base, Model Source=Local, Attack Mode=Q2T, Dim=7682025.10 | 0 | 0.5 | 0.99 | |
| RAG-PULLModel=Qwen3-8B, Model Source=API, Attack Mode=Q2T, Dim=40962025.10 | 0 | 1.33 | 3.33 | |
| RAG-PULLModel=Mistral Embed, Model Source=API, Attack Mode=Q2T, Dim=10242025.10 | 0 | 0.45 | 0.45 | |
| RAG-PULLModel=OpenAI Large, Model Source=API, Attack Mode=Q2T, Dim=30722025.10 | 0 | 0.78 | 1.95 | |
| RAG-PULLModel=BGE-M3, Model Source=API, Attack Mode=Q2T, Dim=10242025.10 | 0 | 2.38 | 7.94 | |
| RAG-PULLModel=BGE-Large, Model Source=API, Attack Mode=Q2T, Dim=10242025.10 | 0 | 0 | 0 |