Question Answering under PIA attack on Bio
75.2AccuracyRADAR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RADARLLM=GPT-4o, Top-k=10, Pos=12026.05 | 75.2 | 68.8 | 82.2 | |
| RADARLLM=Grok-4-fast, Top-k=50, Pos=252026.05 | 74.2 | 53.2 | 70.8 | |
| ReliabilityRAGLLM=Grok-4-fast, Top-k=50, Pos=252026.05 | 74 | 48.8 | 71.8 | |
| RADARLLM=GPT-4o, Top-k=50, Pos=502026.05 | 73.6 | 67.6 | 79.6 | |
| RADARLLM=GPT-4o, Top-k=50, Pos=252026.05 | 73.4 | 70.8 | 79 | |
| RADARLLM=Grok-4-fast, Top-k=10, Pos=102026.05 | 72.8 | 55 | 73.8 | |
| RADARLLM=GPT-4o, Top-k=50, Pos=12026.05 | 72 | 65.6 | 77.8 | |
| ReliabilityRAGLLM=Grok-4-fast, Top-k=10, Pos=102026.05 | 71.8 | 47.8 | 67.8 | |
| RobustRAGLLM=Grok-4-fast, Top-k=50, Pos=502026.05 | 71.4 | 55.6 | 74 | |
| RobustRAGLLM=Grok-4-fast, Top-k=50, Pos=252026.05 | 71.2 | 56.2 | 71.4 | |
| AstuteRAGLLM=GPT-4o, Top-k=50, Pos=252026.05 | 70 | 67.8 | 78.4 | |
| AstuteRAGLLM=GPT-4o, Top-k=50, Pos=12026.05 | 69.8 | 67.2 | 77.6 | |
| AstuteRAGLLM=GPT-4o, Top-k=50, Pos=502026.05 | 69.8 | 66.8 | 77 | |
| RADARLLM=Grok-4-fast, Top-k=50, Pos=502026.05 | 69.8 | 50.8 | 67.2 | |
| InstructRAGLLM=GPT-4o, Top-k=50, Pos=252026.05 | 69.6 | 64.2 | 74 | |
| RobustRAGLLM=Grok-4-fast, Top-k=10, Pos=102026.05 | 69.6 | 64.4 | 75.8 | |
| RADARLLM=Grok-4-fast, Top-k=50, Pos=12026.05 | 69.6 | 54 | 67 | |
| RADARLLM=GPT-4o, Top-k=10, Pos=102026.05 | 69.2 | 68.8 | 78.2 | |
| InstructRAGLLM=GPT-4o, Top-k=50, Pos=502026.05 | 69 | 64.6 | 72.6 | |
| ReliabilityRAGLLM=GPT-4o, Top-k=50, Pos=252026.05 | 68.4 | 66.8 | 74.2 | |
| AstuteRAGLLM=GPT-4o, Top-k=10, Pos=12026.05 | 68.2 | 69.8 | 78.2 | |
| ReliabilityRAGLLM=GPT-4o, Top-k=50, Pos=502026.05 | 68 | 67.8 | 76.2 | |
| RADARLLM=Grok-4-fast, Top-k=10, Pos=12026.05 | 68 | 55.6 | 69.8 | |
| InstructRAGLLM=GPT-4o, Top-k=10, Pos=102026.05 | 67.6 | 66.8 | 77.6 | |
| ReliabilityRAGLLM=GPT-4o, Top-k=10, Pos=102026.05 | 67.6 | 66.4 | 75.4 | |
| AstuteRAGLLM=GPT-4o, Top-k=10, Pos=102026.05 | 66.8 | 62.4 | 73 | |
| ReliabilityRAGLLM=Grok-4-fast, Top-k=10, Pos=12026.05 | 66 | 43.2 | 62.4 | |
| ReliabilityRAGLLM=GPT-4o, Top-k=10, Pos=12026.05 | 64.8 | 64.4 | 73.6 | |
| ReliabilityRAGLLM=Grok-4-fast, Top-k=50, Pos=12026.05 | 64 | 38.4 | 59.8 | |
| RobustRAGLLM=Grok-4-fast, Top-k=10, Pos=12026.05 | 63.6 | 59.8 | 70.6 | |
| ReliabilityRAGLLM=Grok-4-fast, Top-k=50, Pos=502026.05 | 63.2 | 40.8 | 57.6 | |
| RobustRAGLLM=Grok-4-fast, Top-k=50, Pos=12026.05 | 61 | 53.4 | 65.8 | |
| InstructRAGLLM=GPT-4o, Top-k=50, Pos=12026.05 | 60.8 | 51.2 | 66.2 | |
| InstructRAGLLM=GPT-4o, Top-k=10, Pos=12026.05 | 59.4 | 47 | 65.4 | |
| InstructRAGLLM=Grok-4-fast, Top-k=10, Pos=102026.05 | 58.2 | 30.2 | 49.8 | |
| Vanilla RAGLLM=Grok-4-fast, Top-k=10, Pos=12026.05 | 57.6 | 39.8 | 53.4 | |
| ReliabilityRAGLLM=GPT-4o, Top-k=50, Pos=12026.05 | 57.6 | 58.2 | 66 | |
| InstructRAGLLM=Grok-4-fast, Top-k=50, Pos=252026.05 | 57.4 | 31.4 | 48.2 | |
| InstructRAGLLM=Grok-4-fast, Top-k=50, Pos=12026.05 | 56 | 32.2 | 50.2 | |
| RobustRAGLLM=GPT-4o, Top-k=50, Pos=12026.05 | 55.2 | 58 | 68.8 | |
| Vanilla RAGLLM=Grok-4-fast, Top-k=50, Pos=12026.05 | 54.4 | 39.4 | 54.6 | |
| InstructRAGLLM=Grok-4-fast, Top-k=10, Pos=12026.05 | 53.8 | 29.8 | 48 | |
| AstuteRAGLLM=Grok-4-fast, Top-k=50, Pos=252026.05 | 52.6 | 27 | 44 | |
| InstructRAGLLM=Grok-4-fast, Top-k=50, Pos=502026.05 | 52.6 | 26.2 | 44.8 | |
| RobustRAGLLM=GPT-4o, Top-k=10, Pos=102026.05 | 50.8 | 45.2 | 64.4 | |
| RobustRAGLLM=GPT-4o, Top-k=50, Pos=502026.05 | 50.8 | 45.2 | 64.4 | |
| AstuteRAGLLM=Grok-4-fast, Top-k=50, Pos=502026.05 | 48.8 | 26.4 | 43.4 | |
| AstuteRAGLLM=Grok-4-fast, Top-k=10, Pos=102026.05 | 47 | 24.8 | 38 | |
| RobustRAGLLM=GPT-4o, Top-k=10, Pos=12026.05 | 44.6 | 40 | 58.2 | |
| RobustRAGLLM=GPT-4o, Top-k=50, Pos=252026.05 | 44.6 | 40 | 58.2 | |
| Vanilla RAGLLM=GPT-4o, Top-k=50, Pos=12026.05 | 39.2 | 37.2 | 43.6 | |
| Vanilla RAGLLM=Grok-4-fast, Top-k=50, Pos=252026.05 | 38.8 | 27.4 | 36.4 | |
| Vanilla RAGLLM=GPT-4o, Top-k=10, Pos=12026.05 | 36.8 | 34.2 | 42 | |
| AstuteRAGLLM=Grok-4-fast, Top-k=50, Pos=12026.05 | 31.8 | 24.4 | 31.6 | |
| Vanilla RAGLLM=GPT-4o, Top-k=50, Pos=252026.05 | 28.2 | 26.4 | 30.6 | |
| AstuteRAGLLM=Grok-4-fast, Top-k=10, Pos=12026.05 | 27.4 | 22.8 | 28.8 | |
| Vanilla RAGLLM=Grok-4-fast, Top-k=50, Pos=502026.05 | 13 | 12.8 | 17 | |
| Vanilla RAGLLM=Grok-4-fast, Top-k=10, Pos=102026.05 | 9.6 | 9.4 | 12.4 | |
| Vanilla RAGLLM=GPT-4o, Top-k=10, Pos=102026.05 | 8.8 | 8.4 | 10.2 | |
| Vanilla RAGLLM=GPT-4o, Top-k=50, Pos=502026.05 | 8.8 | 8.6 | 10.6 |