Transition Prediction on CascadeBench
50.9IoUQwen-3.5-27B-LoRA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Qwen-3.5-27B-LoRAType=Finetuned Models, Access to Business Rules (BR)=w/ BR2026.05 | 50.9 | 61.47 | |
| GPT-5Type=Frontier Models, Access to Business Rules (BR)=w/ BR2026.05 | 41.78 | 61.5 | |
| Gemini 3 ProType=Frontier Models, Access to Business Rules (BR)=w/ BR2026.05 | 41.36 | 59.53 | |
| Gemma-4-31B-LoRAType=Finetuned Models, Access to Business Rules (BR)=w/ BR2026.05 | 41.33 | 52.62 | |
| Qwen-3.6-27B-LoRAType=Finetuned Models, Access to Business Rules (BR)=w/ BR2026.05 | 40.47 | 60.93 | |
| Opus 4.6Type=Frontier Models, Access to Business Rules (BR)=w/ BR2026.05 | 40.46 | 59.69 | |
| Qwen-3.5-27BType=Base Models, Access to Business Rules (BR)=w/ BR2026.05 | 40.39 | 60.86 | |
| Qwen-3.6-27BType=Base Models, Access to Business Rules (BR)=w/ BR2026.05 | 38.98 | 60.06 | |
| Sonnet 4.6Type=Frontier Models, Access to Business Rules (BR)=w/ BR2026.05 | 38.15 | 57.67 | |
| Gemma-4-31BType=Base Models, Access to Business Rules (BR)=w/ BR2026.05 | 37.99 | 60.32 | |
| Gemma-4-31B-LoRAType=Finetuned Models, Access to Business Rules (BR)=w/o BR2026.05 | 12.19 | 16.41 | |
| Opus 4.6Type=Frontier Models, Access to Business Rules (BR)=w/o BR2026.05 | 10.91 | 16.15 | |
| Qwen-3.5-27B-LoRAType=Finetuned Models, Access to Business Rules (BR)=w/o BR2026.05 | 10.6 | 14.51 | |
| Gemini 3 ProType=Frontier Models, Access to Business Rules (BR)=w/o BR2026.05 | 10.38 | 13.92 | |
| Sonnet 4.6Type=Frontier Models, Access to Business Rules (BR)=w/o BR2026.05 | 10.3 | 10.53 | |
| Gemma-4-31BType=Base Models, Access to Business Rules (BR)=w/o BR2026.05 | 9.88 | 13.76 | |
| GPT-5Type=Frontier Models, Access to Business Rules (BR)=w/o BR2026.05 | 9.82 | 13.25 | |
| Qwen-3.5-27BType=Base Models, Access to Business Rules (BR)=w/o BR2026.05 | 9.77 | 13.18 | |
| Qwen-3.6-27B-LoRAType=Finetuned Models, Access to Business Rules (BR)=w/o BR2026.05 | 9.74 | 13.4 | |
| Qwen-3.6-27BType=Base Models, Access to Business Rules (BR)=w/o BR2026.05 | 7.13 | 13.15 |