Adversarial Retrieval on Python CyberNative C1
74.76Hit Rate @1RAG-PULL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RAG-PULLModel=SFR-2B, Attack Mode=Both, Dim=23042025.10 | 74.76 | 100 | 100 | |
| RAG-PULLModel=jina-1.5B, Model Source=Local, Attack Mode=Q2T, Dim=15362025.10 | 27.03 | 35.91 | 40.15 | |
| RAG-PULLModel=SFR-2B, Attack Mode=Q2T, Dim=23042025.10 | 25.59 | 39.57 | 44.08 | |
| RAG-PULLModel=Mistral Embed, Model Source=API, Attack Mode=Q2T, Dim=10242025.10 | 24.91 | 32.25 | 36.18 | |
| RAG-PULLModel=OpenAI Ada-002, Model Source=API, Attack Mode=Q2T, Dim=15362025.10 | 22.6 | 26.7 | 27.99 | |
| RAG-PULLModel=Qwen3-8B, Model Source=API, Attack Mode=Q2T, Dim=40962025.10 | 22.53 | 27.99 | 31.4 | |
| RAG-PULLModel=Codestral Embed, Model Source=API, Attack Mode=Q2T, Dim=15362025.10 | 20.39 | 25.24 | — | |
| RAG-PULLModel=OpenAI Large, Model Source=API, Attack Mode=Q2T, Dim=30722025.10 | 18.81 | 25.24 | 27.86 | |
| RAG-PULLModel=OpenAI Small, Model Source=API, Attack Mode=Q2T, Dim=15362025.10 | 18.44 | 30.47 | 36.08 | |
| RAG-PULLModel=Gemini Embed, Model Source=API, Attack Mode=Q2T, Dim=30722025.10 | 17.7 | 24.34 | 26.11 | |
| RAG-PULLModel=BGE-M3, Model Source=API, Attack Mode=Q2T, Dim=10242025.10 | 16.88 | 25.21 | 29.06 | |
| RAG-PULLModel=BGE-Large, Model Source=API, Attack Mode=Q2T, Dim=10242025.10 | 16.57 | 21.09 | 23.92 | |
| RAG-PULLModel=Perplexity 4B, Model Source=API, Attack Mode=Q2T, Dim=25602025.10 | 12.26 | 17.43 | 21.57 | |
| RAG-PULLModel=SFR-2B, Attack Mode=T2Q, Dim=23042025.10 | 8.96 | 13.92 | 16.51 | |
| RAG-PULLModel=SFR-400M, Model Source=Local, Attack Mode=Q2T, Dim=10242025.10 | 1.89 | 4.72 | 7.31 | |
| RAG-PULLModel=jina-base, Model Source=Local, Attack Mode=Q2T, Dim=7682025.10 | 0.71 | 3.07 | 5.42 |