Explicit Attack on Medium
3Avg Expected Queries (E)gem-2.5-flash
Evaluation Results
| Method | Links | |
|---|---|---|
| gem-2.5-flashSystem Setup=Pure SQL Agent (PS)2026.02 | 3 | |
| gem-2.5-flashSystem Setup=Orchestrator with SQL Agent (OS)2026.02 | 3 | |
| gpt-4.1-miniSystem Setup=Orchestrator with SQL Agent (OS)2026.02 | 4 | |
| gpt-4.1-miniSystem Setup=Orchestrator with SQL and Notification Agent (ON)2026.02 | 4 | |
| gpt-4.1-miniSystem Setup=Orchestrator with Additional Agents (OA)2026.02 | 4 | |
| gpt-4.1-miniSystem Setup=Pure SQL Agent (PS)2026.02 | 6 | |
| gpt-4.1System Setup=Orchestrator with SQL Agent (OS)2026.02 | 8 | |
| sonnet-4System Setup=Orchestrator with SQL Agent (OS)2026.02 | 9 | |
| gpt-4.1System Setup=Pure SQL Agent (PS)2026.02 | 10 | |
| sonnet-4System Setup=Pure SQL Agent (PS)2026.02 | 10 | |
| gpt-4.1System Setup=Orchestrator with SQL and Notification Agent (ON)2026.02 | 17 | |
| gem-2.5-flashSystem Setup=Orchestrator with SQL and Notification Agent (ON)2026.02 | 17 | |
| gpt-4.1System Setup=Orchestrator with Additional Agents (OA)2026.02 | 18 | |
| gem-2.5-flashSystem Setup=Orchestrator with Additional Agents (OA)2026.02 | 20 | |
| o4-miniSystem Setup=Orchestrator with SQL Agent (OS)2026.02 | 59 | |
| o4-miniSystem Setup=Pure SQL Agent (PS)2026.02 | 84 |