Sub-concept Matching on SCAR
78System AccuracyGrok-4
Evaluation Results
| Method | Links | |
|---|---|---|
| Grok-4Background Descriptions=-BG2026.05 | 78 | |
| Grok-4Background Descriptions=+BG2026.05 | 76 | |
| DeepSeek-R1Background Descriptions=-BG2026.05 | 76 | |
| GPT-OSS-120BBackground Descriptions=-BG2026.05 | 72 | |
| Qwen3-32BBackground Descriptions=-BG2026.05 | 71 | |
| DeepSeek-R1Background Descriptions=+BG2026.05 | 70 | |
| Qwen3-14BBackground Descriptions=-BG2026.05 | 70 | |
| GPT-OSS-120BBackground Descriptions=+BG2026.05 | 69 | |
| Qwen3-14BBackground Descriptions=+BG2026.05 | 68 | |
| GPT-OSS-20BBackground Descriptions=-BG2026.05 | 68 | |
| GPT-4.1-miniBackground Descriptions=-BG2026.05 | 68 | |
| GPT-OSS-20BBackground Descriptions=+BG2026.05 | 66 | |
| GPT-4.1-miniBackground Descriptions=+BG2026.05 | 66 | |
| Qwen3-32BBackground Descriptions=+BG2026.05 | 65 | |
| Gemini-2.5Background Descriptions=-BG2026.05 | 64 | |
| Llama-405BBackground Descriptions=-BG2026.05 | 62 | |
| Llama-70BBackground Descriptions=-BG2026.05 | 60 | |
| Llama-70BBackground Descriptions=+BG2026.05 | 57 | |
| Llama-405BBackground Descriptions=+BG2026.05 | 56 | |
| Gemini-2.5Background Descriptions=+BG2026.05 | 54 | |
| Llama-8BBackground Descriptions=-BG2026.05 | 46 | |
| GPT-4.1-nanoBackground Descriptions=-BG2026.05 | 46 | |
| Llama-8BBackground Descriptions=+BG2026.05 | 40 | |
| GPT-4.1-nanoBackground Descriptions=+BG2026.05 | 37 |