Adversarial Retrieval on Java VFD B1
100Recall@1RAG-PULL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RAG-PULLModel=SFR-2B, Attack Mode=Both, Dim=23042025.10 | 100 | 100 | 100 | |
| RAG-PULLModel=SFR-2B, Attack Mode=Q2T, Dim=23042025.10 | 99.58 | 99.58 | 99.58 | |
| RAG-PULLModel=jina-1.5B, Model Source=Local, Attack Mode=Q2T, Dim=15362025.10 | 97.91 | 99.58 | 100 | |
| RAG-PULLModel=Qwen3-8B, Model Source=API, Attack Mode=Q2T, Dim=40962025.10 | 70.29 | 75.73 | 78.66 | |
| RAG-PULLModel=OpenAI Ada-002, Model Source=API, Attack Mode=Q2T, Dim=15362025.10 | 66.95 | 79.5 | 86.19 | |
| RAG-PULLModel=jina-base, Model Source=Local, Attack Mode=Q2T, Dim=7682025.10 | 50.21 | 67.78 | 77.82 | |
| RAG-PULLModel=Perplexity 4B, Model Source=API, Attack Mode=Q2T, Dim=25602025.10 | 38.91 | 58.16 | 67.36 | |
| RAG-PULLModel=OpenAI Small, Model Source=API, Attack Mode=Q2T, Dim=15362025.10 | 27.62 | 37.66 | 46.86 | |
| RAG-PULLModel=Mistral Embed, Model Source=API, Attack Mode=Q2T, Dim=10242025.10 | 23.01 | 32.64 | 40.59 | |
| RAG-PULLModel=Codestral Embed, Model Source=API, Attack Mode=Q2T, Dim=15362025.10 | 7.53 | 13.81 | 18.41 | |
| RAG-PULLModel=OpenAI Large, Model Source=API, Attack Mode=Q2T, Dim=30722025.10 | 5.02 | 8.37 | 9.62 | |
| RAG-PULLModel=BGE-M3, Model Source=API, Attack Mode=Q2T, Dim=10242025.10 | 0.87 | 1.75 | 1.75 | |
| RAG-PULLModel=SFR-2B, Attack Mode=T2Q, Dim=23042025.10 | 0 | 0 | 0 | |
| RAG-PULLModel=SFR-400M, Model Source=Local, Attack Mode=Q2T, Dim=10242025.10 | 0 | 0 | 0 | |
| RAG-PULLModel=Gemini Embed, Model Source=API, Attack Mode=Q2T, Dim=30722025.10 | 0 | 0 | 0 | |
| RAG-PULLModel=BGE-Large, Model Source=API, Attack Mode=Q2T, Dim=10242025.10 | 0 | 0 | 0 |