Learning to Rank on Yahoo! LETOR set1 (test)
0.462ERR@5CUOLR(CQL)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CUOLR(CQL)CLICK MODEL=CCM2023.06 | 0.462 | 0.438 | 0.478 | 0.681 | 0.704 | 0.758 | |
| ORACLE2023.06 | 0.462 | 0.44 | 0.486 | 0.72 | 0.739 | 0.781 | |
| ORACLE2023.06 | 0.462 | — | 0.476 | — | 0.739 | 0.781 | |
| CUOLR(SAC)CLICK MODEL=CASCADE2023.06 | 0.461 | 0.44 | 0.478 | 0.67 | 0.696 | 0.748 | |
| CUOLR(CQL)CLICK MODEL=DCM2023.06 | 0.461 | 0.437 | 0.474 | 0.676 | 0.699 | 0.753 | |
| CUOLR(SAC)CLICK MODEL=DCM2023.06 | 0.461 | 0.436 | 0.475 | 0.675 | 0.703 | 0.755 | |
| CUOLR(SAC)click_model=CASCADE2023.06 | 0.461 | — | 0.478 | — | 0.696 | 0.748 | |
| CUOLR(CQL)click_model=DCM2023.06 | 0.461 | — | 0.474 | — | 0.699 | 0.753 | |
| CUOLR(SAC)click_model=DCM2023.06 | 0.461 | — | 0.475 | — | 0.703 | 0.755 | |
| CUOLR(SAC)CLICK MODEL=CCM2023.06 | 0.46 | 0.437 | 0.476 | 0.68 | 0.706 | 0.759 | |
| CUOLR(SAC)CLICK MODEL=PBM2023.06 | 0.459 | 0.437 | 0.478 | 0.674 | 0.7 | 0.753 | |
| CUOLR(CQL)CLICK MODEL=CASCADE2023.06 | 0.459 | 0.436 | 0.479 | 0.668 | 0.696 | 0.748 | |
| CUOLR(SAC)click_model=PBM2023.06 | 0.459 | — | 0.478 | — | 0.7 | 0.753 | |
| CUOLR(CQL)click_model=CASCADE2023.06 | 0.459 | — | 0.479 | — | 0.696 | 0.748 | |
| CUOLR(CQL)CLICK MODEL=PBM2023.06 | 0.458 | 0.437 | 0.473 | 0.678 | 0.7 | 0.753 | |
| CUOLR(SAC)CLICK MODEL=UBM2023.06 | 0.458 | 0.435 | 0.473 | 0.675 | 0.7 | 0.754 | |
| CUOLR(CQL)click_model=PBM2023.06 | 0.458 | — | 0.473 | — | 0.7 | 0.753 | |
| CUOLR(CQL)CLICK MODEL=UBM2023.06 | 0.457 | 0.435 | 0.473 | 0.679 | 0.704 | 0.756 | |
| IPWCLICK MODEL=CCM2023.06 | 0.45 | 0.429 | 0.465 | 0.689 | 0.71 | 0.757 | |
| IPWCLICK MODEL=UBM2023.06 | 0.449 | 0.427 | 0.464 | 0.686 | 0.708 | 0.756 | |
| DLACLICK MODEL=CCM2023.06 | 0.449 | 0.427 | 0.464 | 0.685 | 0.707 | 0.754 | |
| DLACLICK MODEL=UBM2023.06 | 0.448 | 0.426 | 0.463 | 0.687 | 0.708 | 0.756 | |
| CM-IPWCLICK MODEL=DCM2023.06 | 0.447 | 0.426 | 0.463 | 0.683 | 0.704 | 0.752 | |
| CM-IPWclick_model=DCM2023.06 | 0.447 | — | 0.463 | — | 0.704 | 0.752 | |
| IPWCLICK MODEL=PBM2023.06 | 0.446 | 0.424 | 0.462 | 0.678 | 0.7 | 0.748 | |
| IPWclick_model=PBM2023.06 | 0.446 | — | 0.462 | — | 0.7 | 0.748 | |
| CM-IPWCLICK MODEL=CASCADE2023.06 | 0.444 | 0.422 | 0.46 | 0.674 | 0.696 | 0.745 | |
| DLACLICK MODEL=DCM2023.06 | 0.444 | 0.422 | 0.459 | 0.673 | 0.696 | 0.745 | |
| IPWCLICK MODEL=DCM2023.06 | 0.444 | 0.422 | 0.459 | 0.674 | 0.697 | 0.746 | |
| CM-IPWclick_model=CASCADE2023.06 | 0.444 | — | 0.46 | — | 0.696 | 0.745 | |
| DLAclick_model=DCM2023.06 | 0.444 | — | 0.459 | — | 0.696 | 0.745 | |
| IPWclick_model=DCM2023.06 | 0.444 | — | 0.459 | — | 0.697 | 0.746 | |
| IPWCLICK MODEL=CASCADE2023.06 | 0.442 | 0.42 | 0.457 | 0.668 | 0.69 | 0.74 | |
| IPWclick_model=CASCADE2023.06 | 0.442 | — | 0.457 | — | 0.69 | 0.74 | |
| DLACLICK MODEL=CASCADE2023.06 | 0.441 | 0.42 | 0.457 | 0.668 | 0.69 | 0.741 | |
| DLAclick_model=CASCADE2023.06 | 0.441 | — | 0.457 | — | 0.69 | 0.741 | |
| CM-IPWCLICK MODEL=PBM2023.06 | 0.44 | 0.418 | 0.456 | 0.669 | 0.692 | 0.743 | |
| CM-IPWclick_model=PBM2023.06 | 0.44 | — | 0.456 | — | 0.692 | 0.743 | |
| DLACLICK MODEL=PBM2023.06 | 0.439 | 0.418 | 0.455 | 0.669 | 0.691 | 0.742 | |
| DLAclick_model=PBM2023.06 | 0.439 | — | 0.455 | — | 0.691 | 0.742 | |
| CM-IPWCLICK MODEL=CCM2023.06 | 0.438 | 0.416 | 0.453 | 0.659 | 0.684 | 0.736 | |
| CM-IPWCLICK MODEL=UBM2023.06 | 0.437 | 0.415 | 0.453 | 0.664 | 0.689 | 0.74 | |
| LOGGING2023.06 | 0.385 | 0.359 | 0.403 | 0.595 | 0.63 | 0.693 | |
| LOGGING2023.06 | 0.385 | — | 0.403 | — | 0.63 | 0.693 |