Query Recommendation on Industrial Offline Internal
17.7Q_EMQueryAgent-R1
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| QueryAgent-R1Method Category=Ours2026.06 | 17.7 | 26.1 | 11.7 | |
| Qwen3-Emb-4BMethod Category=Inventory-based Retrieval2026.06 | 5.7 | 11.4 | 4.1 | |
| Gemini-3.1-proMethod Category=LLM Direct Inference2026.06 | 5.4 | 9.6 | 2.9 | |
| DeepSeek-v4-flashMethod Category=LLM Direct Inference2026.06 | 4.9 | 6.4 | 2.3 | |
| Qwen3.6-plusMethod Category=LLM Direct Inference2026.06 | 4.7 | 8.4 | 2.8 | |
| Qwen3-Emb-0.6BMethod Category=Inventory-based Retrieval2026.06 | 4.6 | 10.2 | 3.2 | |
| Gemini-3.0-proMethod Category=LLM Direct Inference2026.06 | 4 | — | — | |
| GPT-5.1Method Category=LLM Direct Inference2026.06 | 3.8 | 9.1 | 2.3 | |
| Qwen3-4B BackboneMethod Category=Ours2026.06 | 3.7 | 8.4 | 2.5 | |
| GPT-4oMethod Category=LLM Direct Inference2026.06 | 3.6 | 6.5 | 2 | |
| Qwen3-MaxMethod Category=LLM Direct Inference2026.06 | 3.4 | 6 | 2.1 | |
| DeepSeek-v4-proMethod Category=LLM Direct Inference2026.06 | 3.4 | 7 | 1.8 | |
| +RL trainingMethod Category=Ours, Base Model=Qwen3-4B2026.06 | 3.2 | 10.2 | 2.1 | |
| +RetrievalMethod Category=Ours, Base Model=Qwen3-4B2026.06 | 2.3 | 9.1 | 1.8 | |
| SwingMethod Category=Inventory-based Retrieval2026.06 | 1.3 | 6 | 1.1 |