Sub-concept Generation on SCAR
47Semantic Match AccuracyLlama-70B
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama-70BBackground Descriptions=+BG2026.05 | 47 | |
| Llama-405BBackground Descriptions=+BG2026.05 | 47 | |
| DeepSeek-R1Background Descriptions=+BG2026.05 | 45 | |
| Llama-8BBackground Descriptions=+BG2026.05 | 44 | |
| Grok-4Background Descriptions=+BG2026.05 | 42 | |
| Qwen3-14BBackground Descriptions=+BG2026.05 | 42 | |
| GPT-4.1-miniBackground Descriptions=+BG2026.05 | 42 | |
| Gemini-2.5Background Descriptions=+BG2026.05 | 42 | |
| Qwen3-32BBackground Descriptions=+BG2026.05 | 40 | |
| GPT-OSS-20BBackground Descriptions=+BG2026.05 | 39 | |
| GPT-OSS-120BBackground Descriptions=+BG2026.05 | 34 | |
| GPT-4.1-nanoBackground Descriptions=+BG2026.05 | 34 | |
| DeepSeek-R1Background Descriptions=-BG2026.05 | 33 | |
| Llama-405BBackground Descriptions=-BG2026.05 | 33 | |
| Llama-70BBackground Descriptions=-BG2026.05 | 32 | |
| Grok-4Background Descriptions=-BG2026.05 | 31 | |
| Qwen3-14BBackground Descriptions=-BG2026.05 | 31 | |
| GPT-4.1-miniBackground Descriptions=-BG2026.05 | 31 | |
| Qwen3-32BBackground Descriptions=-BG2026.05 | 31 | |
| Gemini-2.5Background Descriptions=-BG2026.05 | 29 | |
| GPT-OSS-20BBackground Descriptions=-BG2026.05 | 28 | |
| GPT-OSS-120BBackground Descriptions=-BG2026.05 | 27 | |
| Llama-8BBackground Descriptions=-BG2026.05 | 27 | |
| GPT-4.1-nanoBackground Descriptions=-BG2026.05 | 27 |