Completion on HOWTOBENCH
0.91Pearson Correlation (ρ)Elaborated Rubric
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Elaborated RubricSelection=best, Cost ($)=1.312026.04 | 0.91 | 0.83 | 0.92 | |
| Average scoring (ToW w/o plan)Cost ($)=7.022026.04 | 0.9 | 0.61 | 0.82 | |
| Elaborated Rubric + SCn=5, Cost ($)=6.532026.04 | 0.9 | 0.83 | 0.9 | |
| Elaborated Rubric + SCn=10, Cost ($)=13.172026.04 | 0.9 | 0.83 | 0.9 | |
| ToWCost ($)=7.342026.04 | 0.89 | 0.78 | 0.88 | |
| Elaborated RubricSelection=worst, Cost ($)=1.312026.04 | 0.89 | 0.83 | 0.9 | |
| ROUGE-L2026.04 | 0.87 | 0.67 | 0.75 | |
| ToWCost ($)=7.342026.04 | 0.87 | 0.67 | 0.78 | |
| Elaborated RubricSelection=worst, Cost ($)=1.312026.04 | 0.86 | 0.56 | 0.7 | |
| BLEU-12026.04 | 0.85 | 0.67 | 0.8 | |
| Average scoring (ToW w/o plan)Cost ($)=7.022026.04 | 0.85 | 0.56 | 0.67 | |
| Elaborated Rubric + SCn=5, Cost ($)=6.532026.04 | 0.85 | 0.56 | 0.7 | |
| Elaborated Rubric + SCn=10, Cost ($)=13.172026.04 | 0.85 | 0.56 | 0.7 | |
| Auto-PlanSelection=best, Cost ($)=0.892026.04 | 0.85 | 0.72 | 0.82 | |
| Elaborated RubricSelection=best, Cost ($)=1.312026.04 | 0.84 | 0.56 | 0.72 | |
| Auto-Plan + SCn=5, Cost ($)=4.452026.04 | 0.84 | 0.67 | 0.85 | |
| Auto-Plan + SCn=10, Cost ($)=8.932026.04 | 0.84 | 0.67 | 0.77 | |
| Auto-PlanSelection=worst, Cost ($)=0.892026.04 | 0.83 | 0.61 | 0.73 | |
| Auto-PlanSelection=best, Cost ($)=0.892026.04 | 0.73 | 0.56 | 0.72 | |
| Auto-Plan + SCn=5, Cost ($)=4.452026.04 | 0.73 | 0.42 | 0.57 | |
| Auto-Plan + SCn=10, Cost ($)=8.932026.04 | 0.73 | 0.39 | 0.47 | |
| BLEU-12026.04 | 0.7 | 0.5 | 0.62 | |
| Auto-PlanSelection=worst, Cost ($)=0.892026.04 | 0.63 | 0.4 | 0.49 | |
| ROUGE-L2026.04 | 0.46 | 0.22 | 0.32 | |
| BLEU-rt2026.04 | 0.19 | 0.06 | 0.15 | |
| BLEU-rt2026.04 | -0.45 | -0.22 | -0.27 |