Product Rating Prediction on LaMP Rating
0.236MAEPURPLE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PURPLELLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 0.236 | 0.52 | |
| ContrieverLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 0.238 | 0.528 | |
| ICR (Llama-3-8B-Instruct)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 0.238 | 0.531 | |
| RankGPT (GPT-5-nano)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 0.24 | 0.523 | |
| BM25LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 0.245 | 0.544 | |
| RankGPT (Llama-3-8B-Instruct)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 0.247 | 0.546 | |
| REPLUGLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 0.258 | 0.554 | |
| IC-RALMLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 0.261 | 0.555 | |
| PURPLELLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 0.307 | 0.624 | |
| ICR (Llama-3-8B-Instruct)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 0.312 | 0.631 | |
| ContrieverLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 0.314 | 0.631 | |
| REPLUGLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 0.314 | 0.633 | |
| RankGPT (Llama-3-8B-Instruct)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 0.318 | 0.637 | |
| RankGPT (GPT-5-nano)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 0.321 | 0.638 | |
| BM25LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 0.328 | 0.664 | |
| IC-RALMLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 0.351 | 0.671 | |
| PURPLELLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 0.419 | 0.808 | |
| ContrieverLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 0.424 | 0.83 | |
| ICR (Llama-3-8B-Instruct)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 0.424 | 0.83 | |
| BM25LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 0.438 | 0.852 | |
| RankGPT (GPT-5-nano)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 0.444 | 0.865 | |
| RankGPT (Llama-3-8B-Instruct)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 0.446 | 0.863 | |
| IC-RALMLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 0.471 | 0.857 | |
| REPLUGLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 0.486 | 0.891 |