Rationale alignment on Multi-aspect Beer Reviews (test)
0.952AccuracyCOCKATIEL
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| COCKATIELl (number of concepts)=20, Training Label=Overall2023.05 | 0.952 | 0.406 | 0.584 | 0.47 | 0.675 | 0.714 | 0.694 | 0.341 | 0.423 | 0.377 | 0.248 | 0.467 | 0.324 | 0.361 | 0.733 | 0.484 | |
| COCKATIELl (number of concepts)=10, Training Label=Overall2023.05 | 0.952 | 0.395 | 0.584 | 0.455 | 0.633 | 0.564 | 0.597 | 0.273 | 0.674 | 0.389 | 0.26 | 0.435 | 0.325 | 0.414 | 0.661 | 0.509 | |
| ConRATl (number of concepts)=20, Training Label=Overall2023.05 | 0.914 | 0.438 | 0.397 | 0.409 | 0.578 | 0.53 | 0.553 | 0.319 | 0.355 | 0.336 | 0.29 | 0.363 | 0.323 | 0.565 | 0.339 | 0.424 | |
| ConRATl (number of concepts)=10, Training Label=Overall2023.05 | 0.913 | 0.382 | 0.176 | 0.238 | 0.517 | 0.262 | 0.348 | 0.326 | 0.174 | 0.227 | 0.23 | 0.138 | 0.173 | 0.453 | 0.131 | 0.203 | |
| Intro-3Pl (number of concepts)=20, Training Label=Aspect-specific2023.05 | 0.856 | 0.21 | 0.18 | 0.191 | 0.287 | 0.248 | 0.266 | 0.143 | 0.144 | 0.143 | 0.166 | 0.193 | 0.179 | 0.242 | 0.136 | 0.174 | |
| RNPl (number of concepts)=10, Training Label=Aspect-specific2023.05 | 0.844 | 0.327 | 0.145 | 0.195 | 0.401 | 0.12 | 0.185 | 0.333 | 0.187 | 0.24 | 0.251 | 0.174 | 0.206 | 0.323 | 0.098 | 0.1507 | |
| RNP-3Pl (number of concepts)=10, Training Label=Aspect-specific2023.05 | 0.831 | 0.284 | 0.132 | 0.178 | 0.418 | 0.192 | 0.263 | 0.222 | 0.124 | 0.159 | 0.165 | 0.104 | 0.127 | 0.332 | 0.106 | 0.161 | |
| InvRATl (number of concepts)=20, Training Label=Aspect-specific2023.05 | 0.829 | 0.375 | 0.316 | 0.338 | 0.545 | 0.455 | 0.496 | 0.261 | 0.276 | 0.269 | 0.226 | 0.259 | 0.241 | 0.466 | 0.274 | 0.345 | |
| InvRATl (number of concepts)=10, Training Label=Aspect-specific2023.05 | 0.819 | 0.366 | 0.157 | 0.218 | 0.594 | 0.261 | 0.363 | 0.313 | 0.155 | 0.208 | 0.164 | 0.096 | 0.121 | 0.391 | 0.116 | 0.179 | |
| RNPl (number of concepts)=20, Training Label=Aspect-specific2023.05 | 0.811 | 0.247 | 0.213 | 0.249 | 0.286 | 0.232 | 0.265 | 0.221 | 0.21 | 0.215 | 0.177 | 0.241 | 0.204 | 0.281 | 0.167 | 0.209 | |
| Intro-3Pl (number of concepts)=10, Training Label=Aspect-specific2023.05 | 0.809 | 0.24 | 0.122 | 0.161 | 0.51 | 0.26 | 0.344 | 0.188 | 0.097 | 0.128 | 0.165 | 0.106 | 0.129 | 0.097 | 0.026 | 0.041 | |
| RNP-3Pl (number of concepts)=20, Training Label=Aspect-specific2023.05 | 0.805 | 0.26 | 0.218 | 0.233 | 0.304 | 0.256 | 0.278 | 0.193 | 0.204 | 0.198 | 0.103 | 0.12 | 0.111 | 0.439 | 0.284 | 0.345 |