Guide on HOWTOBENCH
0.85Pearson Correlation (ρ)ToW
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ToWCost ($)=7.342026.04 | 0.85 | 0.76 | 0.89 | |
| Elaborated RubricSelection=best, Cost ($)=1.312026.04 | 0.82 | 0.7 | 0.82 | |
| Elaborated Rubric + SCn=10, Cost ($)=13.172026.04 | 0.81 | 0.7 | 0.8 | |
| Auto-PlanSelection=best, Cost ($)=0.892026.04 | 0.81 | 0.63 | 0.77 | |
| Elaborated Rubric + SCn=5, Cost ($)=6.532026.04 | 0.8 | 0.65 | 0.78 | |
| Auto-Plan + SCn=5, Cost ($)=4.452026.04 | 0.79 | 0.54 | 0.67 | |
| Auto-Plan + SCn=10, Cost ($)=8.932026.04 | 0.79 | 0.59 | 0.7 | |
| Average scoring (ToW w/o plan)Cost ($)=7.022026.04 | 0.78 | 0.65 | 0.78 | |
| Elaborated RubricSelection=worst, Cost ($)=1.312026.04 | 0.78 | 0.65 | 0.78 | |
| Auto-PlanSelection=worst, Cost ($)=0.892026.04 | 0.78 | 0.63 | 0.74 | |
| BLEU-12026.04 | 0.65 | 0.54 | 0.69 | |
| ROUGE-L2026.04 | 0.06 | 0.14 | 0.2 | |
| BLEU-rt2026.04 | -0.25 | -0.2 | -0.19 |