Citation Recommendation on LaMP Citation
73.8AccuracyRankGPT (GPT-5-nano)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RankGPT (GPT-5-nano)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 73.8 | 73.5 | |
| PURPLELLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 72.2 | 71.8 | |
| ICR (Llama-3-8B-Instruct)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 71.6 | 71 | |
| BM25LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 71.3 | 70.8 | |
| ContrieverLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 71.2 | 70.8 | |
| RankGPT (Llama-3-8B-Instruct)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 69.7 | 69.1 | |
| IC-RALMLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 66.5 | 66.4 | |
| PURPLELLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 66 | 65.6 | |
| RankGPT (GPT-5-nano)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 65.9 | 65.6 | |
| REPLUGLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 65.8 | 65.4 | |
| ICR (Llama-3-8B-Instruct)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 65.2 | 65 | |
| ContrieverLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 64.6 | 64.5 | |
| BM25LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 63.9 | 63.8 | |
| RankGPT (Llama-3-8B-Instruct)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 63.9 | 63.7 | |
| IC-RALMLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 62 | 61.7 | |
| REPLUGLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 61.2 | 60.2 | |
| RankGPT (GPT-5-nano)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 59.5 | 58 | |
| IC-RALMLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 59.3 | 56.6 | |
| PURPLELLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 59.2 | 58.8 | |
| ContrieverLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 58.5 | 58.1 | |
| ICR (Llama-3-8B-Instruct)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 58.4 | 57.3 | |
| RankGPT (Llama-3-8B-Instruct)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 57 | 56.3 | |
| BM25LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 56.9 | 56.5 | |
| REPLUGLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 55.5 | 47.5 |