Scene Generation on World Craft (test)
94CFRTwo-Stage + Critic (Ours)
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Two-Stage + Critic (Ours)Data=Correction Data2026.01 | 94 | 88 | 3.03 | 99 | 7.13 | 3.64 | 28.07 | 6.8 | |
| Training Variants (w/o Critic)Strategy=Stage 2 Only (Manager)2026.01 | 89 | 78 | 4.11 | 91 | 6.84 | 4.76 | 22.16 | 4.34 | |
| Two-Stage + CriticData=Standard Data2026.01 | 89 | 81 | 3.67 | 94 | 7.07 | 4.39 | 26.83 | 6.04 | |
| Training Variants (w/o Critic)Backbone=Qwen3-(8+32)B2026.01 | 88 | 79 | 3.93 | 92 | 7.1 | 4.76 | 26.36 | 6.17 | |
| Training Variants (w/o Critic)Strategy=End-to-End Fine-tuning2026.01 | 86 | 78 | 5.36 | 87 | 6.12 | 4.81 | 24.83 | 5.33 | |
| Direct Gen. + CriticFramework=Direct Generation + Critic, Backbone=Gemini-3-Pro2026.01 | 84 | 67 | 4.99 | 90 | 5.3 | 5.92 | 23.51 | 4.98 | |
| Enricher + Manager + CriticFramework=Enricher + Manager + Critic, Backbone=Gemini-3-Pro2026.01 | 83 | 68 | 3.77 | 92 | 5.92 | 5.9 | 25.08 | 5.71 | |
| Training Variants (w/o Critic)Backbone=Qwen3-(8+8)B2026.01 | 83 | 73 | 4.64 | 90 | 6.35 | 5.42 | 25.31 | 5.64 | |
| Enricher + Manager + CriticFramework=Enricher + Manager + Critic, Backbone=Qwen3-235B2026.01 | 81 | 71 | 4.72 | 84 | 5.28 | 6.13 | 24.72 | 5.66 | |
| Direct Gen. (Few-shot)Framework=Direct Generation, Inference Mode=Few-shot, Backbone=Gemini-3-Pro2026.01 | 80 | 59 | 5.56 | 86 | 5.02 | 6.87 | 23.29 | 4.67 | |
| Direct Gen. + CriticFramework=Direct Generation + Critic, Backbone=Qwen3-235B2026.01 | 78 | 67 | 6.88 | 83 | 4.37 | 6.17 | 23.73 | 5.03 | |
| Direct Gen. (Few-shot)Framework=Direct Generation, Inference Mode=Few-shot, Backbone=Qwen3-235B2026.01 | 73 | 60 | 7.18 | 80 | 4.09 | 7.22 | 23.34 | 4.74 | |
| Direct Gen. + CriticFramework=Direct Generation + Critic, Backbone=Qwen3-32B2026.01 | 66 | 49 | 8.68 | 78 | 3.43 | 9.31 | 20.24 | 3.88 | |
| Enricher + Manager + CriticFramework=Enricher + Manager + Critic, Backbone=Qwen3-(8+32)B2026.01 | 66 | 52 | 7.47 | 77 | 4.46 | 9.33 | 21.45 | 4.03 | |
| Training Variants (w/o Critic)Strategy=Stage 1 Only (Enricher)2026.01 | 63 | 46 | 8.16 | 76 | 3.97 | 9.88 | 25.22 | 5.22 | |
| Direct Gen. (Few-shot)Framework=Direct Generation, Inference Mode=Few-shot, Backbone=Qwen3-32B2026.01 | 59 | 44 | 9.27 | 76 | 3.27 | 10.55 | 20.22 | 3.73 |