Multimodal Database Question Answering on SemBench cars
148.78Latency (s)BlendSQL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BlendSQLModel=gemma-4-E4B-it, Evaluation Setting=BlendSQL, Quantization=FP8, Max Concurrency=642026.06 | 148.78 | 53 | 0.04 | |
| SemBench SystemModel=gemini-2.5-flash, Evaluation Setting=Avg. SemBench System2026.06 | 408.07 | 67 | 8.83 |