# Item Recommendation on DBbook @10 2014 (test)

Source: [Item Recommendation on DBbook @10 2014 (test)](<https://www.sota2.com/research/sota/item-recommendation-on-dbbook-at-10-2014-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:46:27.741Z

Evaluation of Item Recommendation performance on the test split of the DBbook @10 2014 dataset, measured using Precision, Recall, F1, Hit Rate, and NDCG.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Item Recommendation |
| Dataset (including any stated split) | DBbook @10 2014 (test) |
| Metric | Hit Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 19 of 19 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Hit Rate](<https://www.sota2.com/research/sota/item-recommendation-on-dbbook-at-10-2014-test.md?metric=Hit%20Rate>): Higher is better; unit: PERCENT.

- [Precision](<https://www.sota2.com/research/sota/item-recommendation-on-dbbook-at-10-2014-test.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/item-recommendation-on-dbbook-at-10-2014-test.md?metric=Recall>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/item-recommendation-on-dbbook-at-10-2014-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [NDCG](<https://www.sota2.com/research/sota/item-recommendation-on-dbbook-at-10-2014-test.md?metric=NDCG>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Hit Rate | Result date | Report paper |
| --- | --- | --- | --- |
| Ekar\* | 18.74 | Not recorded | 68fa6b851e209131cea2ecaa |
| ConvE-Rec | 18.5 | Not recorded | 68fa6b851e209131cea2ecaa |
| KTUP | 17.61 | Not recorded | 68fa6b851e209131cea2ecaa |
| Ekar | 17.16 | Not recorded | 68fa6b851e209131cea2ecaa |
| CFKG | 14.28 | Not recorded | 68fa6b851e209131cea2ecaa |
| MKR | 8.63 | Not recorded | 68fa6b851e209131cea2ecaa |
| BPR-MF | 8.29 | Not recorded | 68fa6b851e209131cea2ecaa |
| RippleNet | 7.63 | Not recorded | 68fa6b851e209131cea2ecaa |
| ItemKNN | 7.02 | Not recorded | 68fa6b851e209131cea2ecaa |
| KTUP | 0.3461 | Not recorded | 68fa65691e209131cea0a2ea |
| KTUP | 0.3449 | Not recorded | 68fa65691e209131cea0a2ea |
| CKE | 0.3318 | Not recorded | 68fa65691e209131cea0a2ea |
| TUP | 0.3142 | Not recorded | 68fa65691e209131cea0a2ea |
| BPRMF | 0.3126 | Not recorded | 68fa65691e209131cea0a2ea |
| FM | 0.3015 | Not recorded | 68fa65691e209131cea0a2ea |
| CoFM | 0.2984 | Not recorded | 68fa65691e209131cea0a2ea |
| TUP | 0.2956 | Not recorded | 68fa65691e209131cea0a2ea |
| CoFM | 0.2896 | Not recorded | 68fa65691e209131cea0a2ea |
| CFKG | 0.2809 | Not recorded | 68fa65691e209131cea0a2ea |

### Ekar\*

Hit Rate: 18.74. Result ID: 698e9389ffc3901de09ece4b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

Recorded evaluation configuration: {"ranking strategy":"rewards"}. This record does not assert independent reproduction.

### ConvE-Rec

Hit Rate: 18.5. Result ID: 698e9389ffc3901de09ece49.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64891e209131cea05517.md>)

[Implementation](<https://github.com/TimDettmers/ConvE>)

Recorded evaluation configuration: {"KG embedding":"ConvE"}. This record does not assert independent reproduction.

### KTUP

Hit Rate: 17.61. Result ID: 698e9389ffc3901de09ece48.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Implementation](<https://github.com/TaoMiner/joint-kg-recommender>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Ekar

Hit Rate: 17.16. Result ID: 698e9389ffc3901de09ece4a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

Recorded evaluation configuration: {"ranking strategy":"path probabilities"}. This record does not assert independent reproduction.

### CFKG

Hit Rate: 14.28. Result ID: 698e9389ffc3901de09ece46.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64de1e209131cea06ed5.md>)

Recorded evaluation configuration: {"KG embedding":"TransE"}. This record does not assert independent reproduction.

### MKR

Hit Rate: 8.63. Result ID: 698e9389ffc3901de09ece47.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa654b1e209131cea095aa.md>)

[Implementation](<https://github.com/hwwang55/MKR>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BPR-MF

Hit Rate: 8.29. Result ID: 698e9389ffc3901de09ece44.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RippleNet

Hit Rate: 7.63. Result ID: 698e9389ffc3901de09ece45.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64bb1e209131cea061d5.md>)

[Implementation](<https://github.com/hwwang55/RippleNet>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ItemKNN

Hit Rate: 7.02. Result ID: 698e9389ffc3901de09ece43.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b851e209131cea2ecaa.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### KTUP

Hit Rate: 0.3461. Result ID: 698cab078b517eb4331befca.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Implementation](<https://github.com/TaoMiner/joint-kg-recommender>)

Recorded evaluation configuration: {"Preference induction strategy":"soft","Top-N rank":"10"}. This record does not assert independent reproduction.

### KTUP

Hit Rate: 0.3449. Result ID: 698cab078b517eb4331befc9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Implementation](<https://github.com/TaoMiner/joint-kg-recommender>)

Recorded evaluation configuration: {"Preference induction strategy":"hard","Top-N rank":"10"}. This record does not assert independent reproduction.

### CKE

Hit Rate: 0.3318. Result ID: 698cab078b517eb4331befc4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

Recorded evaluation configuration: {"Top-N rank":"10"}. This record does not assert independent reproduction.

### TUP

Hit Rate: 0.3142. Result ID: 698cab078b517eb4331befc8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Implementation](<https://github.com/TaoMiner/joint-kg-recommender>)

Recorded evaluation configuration: {"Preference induction strategy":"soft","Top-N rank":"10"}. This record does not assert independent reproduction.

### BPRMF

Hit Rate: 0.3126. Result ID: 698cab078b517eb4331befc2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa608c1e209131ce9f0076.md>)

Recorded evaluation configuration: {"Top-N rank":"10"}. This record does not assert independent reproduction.

### FM

Hit Rate: 0.3015. Result ID: 698cab078b517eb4331befc1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

Recorded evaluation configuration: {"Top-N rank":"10"}. This record does not assert independent reproduction.

### CoFM

Hit Rate: 0.2984. Result ID: 698cab078b517eb4331befc5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

Recorded evaluation configuration: {"Model variant":"share","Top-N rank":"10"}. This record does not assert independent reproduction.

### TUP

Hit Rate: 0.2956. Result ID: 698cab078b517eb4331befc7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Implementation](<https://github.com/TaoMiner/joint-kg-recommender>)

Recorded evaluation configuration: {"Preference induction strategy":"hard","Top-N rank":"10"}. This record does not assert independent reproduction.

### CoFM

Hit Rate: 0.2896. Result ID: 698cab078b517eb4331befc6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

Recorded evaluation configuration: {"Model variant":"reg","Top-N rank":"10"}. This record does not assert independent reproduction.

### CFKG

Hit Rate: 0.2809. Result ID: 698cab078b517eb4331befc3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65691e209131cea0a2ea.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64de1e209131cea06ed5.md>)

Recorded evaluation configuration: {"Top-N rank":"10"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
