Explicit Attack on Toy
500Avg Queries (E)o4-mini
Evaluation Results
| Method | Links | |
|---|---|---|
| o4-miniSystem Setup=Orchestrator with SQL and Notification Agent (ON)2026.02 | 500 | |
| o4-miniSystem Setup=Pure SQL Agent (PS)2026.02 | 42 | |
| gpt-4.1System Setup=Orchestrator with Additional Agents (OA)2026.02 | 39 | |
| gem-2.5-flashSystem Setup=Orchestrator with SQL and Notification Agent (ON)2026.02 | 33 | |
| gpt-4.1System Setup=Orchestrator with SQL and Notification Agent (ON)2026.02 | 23 | |
| o4-miniSystem Setup=Orchestrator with SQL Agent (OS)2026.02 | 16 | |
| sonnet-4System Setup=Pure SQL Agent (PS)2026.02 | 15 | |
| gpt-4.1System Setup=Pure SQL Agent (PS)2026.02 | 12 | |
| sonnet-4System Setup=Orchestrator with SQL Agent (OS)2026.02 | 12 | |
| gpt-4.1System Setup=Orchestrator with SQL Agent (OS)2026.02 | 10 | |
| gem-2.5-flashSystem Setup=Orchestrator with Additional Agents (OA)2026.02 | 8 | |
| gpt-4.1-miniSystem Setup=Pure SQL Agent (PS)2026.02 | 6 | |
| gpt-4.1-miniSystem Setup=Orchestrator with SQL and Notification Agent (ON)2026.02 | 6 | |
| gpt-4.1-miniSystem Setup=Orchestrator with Additional Agents (OA)2026.02 | 6 | |
| gpt-4.1-miniSystem Setup=Orchestrator with SQL Agent (OS)2026.02 | 4 | |
| gem-2.5-flashSystem Setup=Pure SQL Agent (PS)2026.02 | 4 | |
| gem-2.5-flashSystem Setup=Orchestrator with SQL Agent (OS)2026.02 | 4 |