Hybrid SQL Querying on SemBench wildlife
4.01Latency (s)BlendSQL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BlendSQLModel=gemma-4-E4B-it-FP8, Query=Q4, Max Concurrency=642026.06 | 4.01 | 40 | 0.001 | |
| BlendSQLModel=gemma-4-E4B-it-FP8, Query=Q2, Max Concurrency=642026.06 | 4.16 | 0 | 0.001 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Query=Q42026.06 | 4.47 | 33 | 0.04 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Query=Q22026.06 | 5.57 | 17 | 0.05 | |
| BlendSQLModel=gemma-4-E4B-it-FP8, Query=Q10, Max Concurrency=642026.06 | 9.27 | 40 | 0.002 | |
| BlendSQLModel=gemma-4-E4B-it-FP8, Query=Q3, Max Concurrency=642026.06 | 9.29 | 20 | 0.002 | |
| BlendSQLModel=gemma-4-E4B-it-FP8, Query=Q1, Max Concurrency=642026.06 | 9.41 | 78 | 0.002 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Query=Q52026.06 | 11.67 | 75 | 0.43 | |
| BlendSQLModel=gemma-4-E4B-it-FP8, Query=Q9, Max Concurrency=642026.06 | 11.92 | 61 | 0.003 | |
| BlendSQLModel=gemma-4-E4B-it-FP8, Aggregate=Average, Max Concurrency=642026.06 | 12.01 | 54 | 0.003 | |
| BlendSQLModel=gemma-4-E4B-it-FP8, Query=Q6, Max Concurrency=642026.06 | 13.34 | 20 | 0.003 | |
| BlendSQLModel=gemma-4-E4B-it-FP8, Query=Q5, Max Concurrency=642026.06 | 13.39 | 93 | 0.003 | |
| BlendSQLModel=gemma-4-E4B-it-FP8, Query=Q7, Max Concurrency=642026.06 | 18.58 | 100 | 0.005 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Query=Q62026.06 | 18.93 | 23 | 0.52 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Query=Q92026.06 | 24.63 | 61 | 0.55 | |
| BlendSQLModel=gemma-4-E4B-it-FP8, Query=Q8, Max Concurrency=642026.06 | 26.68 | 83 | 0.007 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Aggregate=Average2026.06 | 28.83 | 51 | 0.49 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Query=Q82026.06 | 31.4 | 75 | 0.8 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Query=Q32026.06 | 38.02 | 25 | 0.47 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Query=Q102026.06 | 38.02 | 25 | 0.47 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Query=Q12026.06 | 44.2 | 79 | 0.57 | |
| Avg. SemBench SystemModel=gemini-2.5-flash, Query=Q72026.06 | 71.4 | 100 | 0.98 |