Recommendation on Books InstructRec retrospective (test)
49.9HR@1ARS
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ARSEvaluation Mode=Retrospective, Backbone LLM=Llama-4-Maverick-17B-128E-Instruct, History Window (Lmax)=152026.05 | 49.9 | 84.6 | 68.2 | 73.1 | |
| MemRecEvaluation Mode=Retrospective, Backbone LLM=Llama-4-Maverick-17B-128E-Instruct, History Window (Lmax)=152026.05 | 39.6 | 77 | 59.1 | 66.2 | |
| iAgentEvaluation Mode=Retrospective, Backbone LLM=Llama-4-Maverick-17B-128E-Instruct, History Window (Lmax)=152026.05 | 33.5 | 66.4 | 49.9 | 60.5 | |
| i2AgentEvaluation Mode=Retrospective, Backbone LLM=Llama-4-Maverick-17B-128E-Instruct, History Window (Lmax)=152026.05 | 32.5 | 71.6 | 52.6 | 61.3 | |
| AgentCFEvaluation Mode=Retrospective, Backbone LLM=Llama-4-Maverick-17B-128E-Instruct2026.05 | 26.3 | 62 | 44.5 | 56.2 | |
| LLMRankEvaluation Mode=Retrospective, Backbone LLM=Llama-4-Maverick-17B-128E-Instruct2026.05 | 21.5 | 60.2 | 41.6 | 53.9 | |
| SASRecEvaluation Mode=Retrospective2026.05 | 19.8 | 70.7 | 46.4 | 55.9 | |
| LightGCNEvaluation Mode=Retrospective2026.05 | 15.2 | 57.4 | 34.3 | 48.6 | |
| BPREvaluation Mode=Retrospective2026.05 | 14 | 56.3 | 34 | 48.3 |