Topic Generation on LongLaMP
30.8R1RankGPT (Llama-3-8B-Instruct)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RankGPT (Llama-3-8B-Instruct)LLM Generator=Llama-3-8B-Instruct (8.03B)2026.01 | 30.8 | 15.2 | 20.4 | |
| ContrieverLLM Generator=Llama-3-8B-Instruct (8.03B)2026.01 | 30.6 | 15.2 | 20 | |
| ICR (Llama-3-8B-Instruct)LLM Generator=Llama-3-8B-Instruct (8.03B)2026.01 | 30.6 | 15.1 | 20.2 | |
| PURPLELLM Generator=Llama-3-8B-Instruct (8.03B)2026.01 | 30.4 | 15 | 19.8 | |
| BM25LLM Generator=Llama-3-8B-Instruct (8.03B)2026.01 | 29.8 | 14.6 | 20.2 | |
| RankGPT (GPT-5-nano)LLM Generator=Llama-3-8B-Instruct (8.03B)2026.01 | 28.7 | 14.2 | 20.2 | |
| PURPLELLM Generator=Phi-4-Mini-Instruct (3.84B)2026.01 | 26.2 | 13.2 | 17.5 | |
| ContrieverLLM Generator=Phi-4-Mini-Instruct (3.84B)2026.01 | 25.7 | 13 | 16.6 | |
| ICR (Llama-3-8B-Instruct)LLM Generator=Phi-4-Mini-Instruct (3.84B)2026.01 | 25.7 | 13 | 16.5 | |
| BM25LLM Generator=Phi-4-Mini-Instruct (3.84B)2026.01 | 25.2 | 12.7 | 17.1 | |
| RankGPT (Llama-3-8B-Instruct)LLM Generator=Phi-4-Mini-Instruct (3.84B)2026.01 | 25.1 | 12.7 | 17.1 | |
| IC-RALMLLM Generator=Llama-3-8B-Instruct (8.03B)2026.01 | 25 | 11.4 | 15.5 | |
| RankGPT (GPT-5-nano)LLM Generator=Phi-4-Mini-Instruct (3.84B)2026.01 | 24.9 | 12.5 | 17.5 | |
| IC-RALMLLM Generator=Phi-4-Mini-Instruct (3.84B)2026.01 | 24.8 | 12.4 | 15.9 | |
| REPLUGLLM Generator=Phi-4-Mini-Instruct (3.84B)2026.01 | 23.5 | 12.1 | 13.1 | |
| REPLUGLLM Generator=Llama-3-8B-Instruct (8.03B)2026.01 | 20.2 | 10.8 | 11.9 |