List your company
ResearchFormerly WizWand

Product Rating Prediction on LaMP Rating

0.236MAEPURPLE
0.2260.29350.3610.4285Jan 17, 2026
Updated 8mo ago

Evaluation results

MethodLinks
PURPLELLM Backbone=Llama-3-70B-Instruct (70.6B)2026.010.2360.52
ContrieverLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.010.2380.528
ICR (Llama-3-8B-Instruct)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.010.2380.531
RankGPT (GPT-5-nano)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.010.240.523
BM25LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.010.2450.544
RankGPT (Llama-3-8B-Instruct)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.010.2470.546
REPLUGLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.010.2580.554
IC-RALMLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.010.2610.555
PURPLELLM Backbone=Llama-3-8B-Instruct (8.03B)2026.010.3070.624
ICR (Llama-3-8B-Instruct)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.010.3120.631
ContrieverLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.010.3140.631
REPLUGLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.010.3140.633
RankGPT (Llama-3-8B-Instruct)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.010.3180.637
RankGPT (GPT-5-nano)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.010.3210.638
BM25LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.010.3280.664
IC-RALMLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.010.3510.671
PURPLELLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.010.4190.808
ContrieverLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.010.4240.83
ICR (Llama-3-8B-Instruct)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.010.4240.83
BM25LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.010.4380.852
RankGPT (GPT-5-nano)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.010.4440.865
RankGPT (Llama-3-8B-Instruct)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.010.4460.863
IC-RALMLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.010.4710.857
REPLUGLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.010.4860.891