Recommendation on Instruments (test)
34.7Hit@1CoARS
Evaluation results
| Method | Links | |
|---|---|---|
| CoARSBackbone=Qwen3-8B2026.04 | 34.7 | |
| CoARSBackbone=Qwen3-4B2026.04 | 27.12 | |
| RecoWorldBackbone=Qwen3-8B2026.04 | 22.22 | |
| RecoWorldBackbone=Qwen3-4B2026.04 | 18.54 | |
| iAgentBackbone=GPT-5.4-mini2026.04 | 15.3 | |
| iAgentBackbone=Qwen3-8B2026.04 | 12.54 | |
| iAgentBackbone=Qwen3-4B2026.04 | 8.9 | |
| AFLBackbone=GPT-5.4-mini2026.04 | 8.11 | |
| AFLBackbone=Qwen3-8B2026.04 | 6.24 | |
| ReflexionBackbone=GPT-5.4-mini2026.04 | 5.48 | |
| AFLBackbone=Qwen3-4B2026.04 | 5.15 | |
| ReflexionBackbone=Qwen3-8B2026.04 | 2.65 | |
| ReflexionBackbone=Qwen3-4B2026.04 | 1.58 |