RAG Generation on Natural Questions (300 queries)
4.3EMgemma4:e4b
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| gemma4:e4bParams=4B (eff.), Deployment=Local (Ollama)2026.06 | 4.3 | 7.6 | 10 | 10.5 | |
| qwen2.5:1.5bParams=1.5B, Deployment=Local (Ollama)2026.06 | 2 | 15.7 | 51.3 | 1.6 | |
| qwen2.5:3bParams=3B, Deployment=Local (Ollama)2026.06 | 1 | 12 | 52.7 | 2.2 | |
| qwen2.5:7bParams=7B, Deployment=Local (Ollama)2026.06 | 0.7 | 14.7 | 56 | 4 | |
| gpt-4o-mini (cloud)Deployment=Cloud (OpenAI API)2026.06 | 0.7 | 17.3 | 60 | 0.9 |