Explicit Attack on Big
3Avg Expected Queriesgem-2.5-flash
Evaluation results
| Method | Links | |
|---|---|---|
| gem-2.5-flashSystem Setup=Orchestrator with SQL Agent (OS)2026.02 | 3 | |
| gpt-4.1-miniSystem Setup=Orchestrator with SQL Agent (OS)2026.02 | 4 | |
| gem-2.5-flashSystem Setup=Pure SQL Agent (PS)2026.02 | 4 | |
| gpt-4.1-miniSystem Setup=Orchestrator with SQL and Notification Agent (ON)2026.02 | 6 | |
| gpt-4.1-miniSystem Setup=Orchestrator with Additional Agents (OA)2026.02 | 6 | |
| gpt-4.1-miniSystem Setup=Pure SQL Agent (PS)2026.02 | 7 | |
| gpt-4.1System Setup=Orchestrator with SQL Agent (OS)2026.02 | 8 | |
| gem-2.5-flashSystem Setup=Orchestrator with SQL and Notification Agent (ON)2026.02 | 9 | |
| gpt-4.1System Setup=Pure SQL Agent (PS)2026.02 | 10 | |
| sonnet-4System Setup=Orchestrator with SQL Agent (OS)2026.02 | 10 | |
| gem-2.5-flashSystem Setup=Orchestrator with Additional Agents (OA)2026.02 | 11 | |
| sonnet-4System Setup=Pure SQL Agent (PS)2026.02 | 12 | |
| gpt-4.1System Setup=Orchestrator with SQL and Notification Agent (ON)2026.02 | 18 | |
| gpt-4.1System Setup=Orchestrator with Additional Agents (OA)2026.02 | 72 | |
| o4-miniSystem Setup=Pure SQL Agent (PS)2026.02 | 72 | |
| o4-miniSystem Setup=Orchestrator with SQL Agent (OS)2026.02 | 100 |