Vignette Completeness on CIRL-Vig
45.8Vignette CompletenessOpenThinker3-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| OpenThinker3-7BCondition=Zero-shot2026.04 | 45.8 | |
| Gemma-3-12BCondition=SFT2026.04 | 45.4 | |
| Gemma-3-12BCondition=Zero-shot2026.04 | 43.6 | |
| Phi-4Condition=Zero-shot2026.04 | 43 | |
| Qwen3.5-9BCondition=SFT2026.04 | 41.6 | |
| Qwen3.5-2BCondition=Zero-shot2026.04 | 41.6 | |
| Qwen3.5-4BCondition=Zero-shot2026.04 | 41.6 | |
| Qwen3.5-2BCondition=SFT2026.04 | 40.8 | |
| Qwen3.5-9BCondition=Zero-shot2026.04 | 38.7 | |
| OpenThinker3-7BCondition=SFT2026.04 | 34.1 | |
| Phi-4Condition=SFT2026.04 | 27.8 | |
| ContextReasoner-7BCondition=Zero-shot2026.04 | 13 | |
| Qwen3.5-9BCondition=GRPO2026.04 | 0 | |
| GPT-OSS-20BCondition=Zero-shot2026.04 | 0 | |
| GPT-OSS-20BCondition=SFT2026.04 | 0 |