Creative Reasoning Assessment on Human Evaluation Scenarios
3.06NoveltyExpert-designed Dialogue Policy
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Expert-designed Dialogue PolicyRater-ID=62026.06 | 3.06 | 3.06 | 3 | 3.38 | 3.12 | |
| Expert-designed Dialogue PolicyRater-ID=32026.06 | 2.81 | 2.75 | 2.75 | 3 | 2.88 | |
| Expert-designed Dialogue PolicyRater-ID=52026.06 | 2.81 | 2.81 | 2.75 | 2.75 | 2.81 | |
| Expert-designed Dialogue PolicyRater-ID=Mean2026.06 | 2.76 | 2.87 | 2.74 | 2.9 | 2.84 | |
| Expert-designed Dialogue PolicyRater-ID=12026.06 | 2.69 | 3.12 | 2.69 | 3 | 2.94 | |
| Expert-designed Dialogue PolicyRater-ID=42026.06 | 2.62 | 2.62 | 2.62 | 2.56 | 2.56 | |
| Expert-designed Dialogue PolicyRater-ID=22026.06 | 2.56 | 2.88 | 2.62 | 2.69 | 2.75 | |
| IntElicitRater-ID=22026.06 | 2.44 | 2.12 | 2.38 | 2.31 | 2.25 | |
| IntElicitRater-ID=42026.06 | 2.38 | 2.38 | 2.38 | 2.44 | 2.44 | |
| IntElicitRater-ID=12026.06 | 2.31 | 1.88 | 2.31 | 2 | 2.06 | |
| IntElicitRater-ID=Mean2026.06 | 2.24 | 2.13 | 2.26 | 2.1 | 2.16 | |
| IntElicitRater-ID=32026.06 | 2.19 | 2.25 | 2.25 | 2 | 2.12 | |
| IntElicitRater-ID=52026.06 | 2.19 | 2.19 | 2.25 | 2.25 | 2.19 | |
| IntElicitRater-ID=62026.06 | 1.94 | 1.94 | 2 | 1.62 | 1.88 |