Database Query Answering on SemBench movie scenario v1
0.32Latency (s)BlendSQL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Q42026.06 | 0.32 | 64 | 0.0001 | |
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Q12026.06 | 0.39 | 100 | 0.0001 | |
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Q22026.06 | 0.45 | 96 | 0.0001 | |
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Q32026.06 | 0.48 | 69 | 0.0001 | |
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Q62026.06 | 0.57 | 46 | 0.0001 | |
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Q52026.06 | 0.63 | 46 | 0.0002 | |
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Q82026.06 | 0.68 | 92 | 0.0002 | |
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Q92026.06 | 0.81 | 87 | 0.0002 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Q32026.06 | 5.2 | 67 | 0.03 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Q42026.06 | 5.6 | 69 | 0.04 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Q82026.06 | 6.08 | 84 | 0.04 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Q92026.06 | 7.97 | 77 | 0.15 | |
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Q102026.06 | 8.88 | 71 | 0.002 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Q22026.06 | 10.8 | 98 | 0.03 | |
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Avg.2026.06 | 16.22 | 72 | 0.004 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Q12026.06 | 16.85 | 99 | 0.18 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Q102026.06 | 34.07 | 42 | 1.07 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Avg.2026.06 | 67.91 | 74 | 2.55 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Q62026.06 | 122.72 | 76 | 3.53 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Q52026.06 | 148.8 | 72 | 4.25 | |
| BlendSQLBackbone=gemma-4-E4B-it, Precision=FP8, Max Concurrency=64, Query ID=Q72026.06 | 149.03 | 54 | 0.04 | |
| Avg. SemBench SystemBackbone=gemini-2.5-flash, Query ID=Q72026.06 | 321 | 54 | 16.24 |