Search Relevance Ranking on Walmart.com sponsored product search 1000 query (test)
71.42NDCG@4Fine-tuned LLaMa2 7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Fine-tuned LLaMa2 7BModel Architecture=LLaMa2, Model Size=7B, Fine-tuning Protocol=Fine-tuned, PEFT Method=LoRA2026.07 | 71.42 | 67.74 | |
| Cross-Encoder BERTModel Architecture=BERT, Encoding Strategy=Cross-Encoder2026.07 | 69.39 | 65.65 | |
| Bi-Encoder BERTModel Architecture=BERT, Encoding Strategy=Bi-Encoder2026.07 | 66.85 | 63.24 |