Personalized Question Answering on PFQABench 1.0 (test)
49.6P-ScorePAG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PAGBackbone=Qwen2.5-14B-IT2026.01 | 49.6 | 24 | 36.8 | |
| PAG + FPPS-SBackbone=Qwen2.5-14B-IT2026.01 | 49.2 | 25.2 | 37.2 | |
| PAG + FPPS-SBackbone=LLaMA3.1-8B-IT2026.01 | 48.4 | 20.8 | 34.6 | |
| PAG + FPPS-MBackbone=Qwen2.5-14B-IT2026.01 | 48.4 | 81.2 | 64.8 | |
| PAG + FPPS-HBackbone=Qwen2.5-14B-IT2026.01 | 48 | 81.2 | 64.6 | |
| PAGBackbone=LLaMA3.1-8B-IT2026.01 | 47.2 | 17.2 | 32.2 | |
| PAG + FPPS-MBackbone=LLaMA3.1-8B-IT2026.01 | 46.4 | 75.2 | 60.8 | |
| PAG + FPPS-SBackbone=Qwen2.5-7B-IT2026.01 | 44.4 | 28 | 36.2 | |
| PAGBackbone=Qwen2.5-7B-IT2026.01 | 44 | 27.6 | 35.8 | |
| PAG + FPPS-MBackbone=Qwen2.5-7B-IT2026.01 | 43.2 | 84.4 | 63.8 | |
| PAG + FPPS-HBackbone=Qwen2.5-7B-IT2026.01 | 40.8 | 80.4 | 62.6 | |
| RAGBackbone=Qwen2.5-14B-IT2026.01 | 38.8 | 30 | 34.4 | |
| PAG + FPPS-HBackbone=LLaMA3.1-8B-IT2026.01 | 37.6 | 80.8 | 59.2 | |
| RAG + FPPS-SBackbone=Qwen2.5-14B-IT2026.01 | 37.6 | 32.8 | 35.2 | |
| DPLBackbone=LLaMA3.1-8B-IT2026.01 | 37.2 | 12 | 24.6 | |
| DPL + FPPS-MBackbone=LLaMA3.1-8B-IT2026.01 | 36.8 | 78.4 | 57.6 | |
| DPL + FPPS-SBackbone=LLaMA3.1-8B-IT2026.01 | 36.4 | 17.6 | 27 | |
| RAG + FPPS-SBackbone=LLaMA3.1-8B-IT2026.01 | 36 | 31.2 | 33.6 | |
| RAG + FPPS-MBackbone=Qwen2.5-14B-IT2026.01 | 36 | 80 | 58 | |
| RAGBackbone=LLaMA3.1-8B-IT2026.01 | 35.6 | 8.8 | 22.2 | |
| RAGBackbone=Qwen2.5-7B-IT2026.01 | 35.6 | 40.4 | 38 | |
| RAG + FPPS-SBackbone=Qwen2.5-7B-IT2026.01 | 35.2 | 43.6 | 39.4 | |
| RAG + FPPS-MBackbone=LLaMA3.1-8B-IT2026.01 | 34.8 | 80.4 | 57.6 | |
| DPL + FPPS-SBackbone=Qwen2.5-7B-IT2026.01 | 34.8 | 36 | 35.4 | |
| DPLBackbone=Qwen2.5-7B-IT2026.01 | 34 | 33.6 | 33.8 | |
| DPL + FPPS-MBackbone=Qwen2.5-7B-IT2026.01 | 34 | 82.4 | 58.2 | |
| RAG + FPPS-HBackbone=Qwen2.5-14B-IT2026.01 | 34 | 80.8 | 57.4 | |
| RAG + FPPS-MBackbone=Qwen2.5-7B-IT2026.01 | 33.6 | 79.2 | 56.4 | |
| DPLBackbone=Qwen2.5-14B-IT2026.01 | 33.2 | 36.8 | 35 | |
| DPL + FPPS-SBackbone=Qwen2.5-14B-IT2026.01 | 33.2 | 39.6 | 36.4 | |
| RAG + FPPS-HBackbone=Qwen2.5-7B-IT2026.01 | 31.6 | 80.8 | 56.2 | |
| DPL + FPPS-MBackbone=Qwen2.5-14B-IT2026.01 | 31.6 | 82 | 56.8 | |
| DPL + FPPS-HBackbone=Qwen2.5-14B-IT2026.01 | 30 | 82.8 | 56.4 | |
| DPL + FPPS-HBackbone=Qwen2.5-7B-IT2026.01 | 28.8 | 85.2 | 57 | |
| LLM-TRSRBackbone=LLaMA3.1-8B-IT2026.01 | 28.4 | 17.6 | 23 | |
| DPL + FPPS-HBackbone=LLaMA3.1-8B-IT2026.01 | 28.3 | 75.1 | 51.7 | |
| LLM-TRSR + FPPS-SBackbone=LLaMA3.1-8B-IT2026.01 | 27.6 | 22.4 | 25 | |
| RAG + FPPS-HBackbone=LLaMA3.1-8B-IT2026.01 | 25.6 | 80.8 | 53.2 | |
| LLM-TRSR + FPPS-SBackbone=Qwen2.5-7B-IT2026.01 | 25.2 | 18.8 | 22 | |
| LLM-TRSR + FPPS-MBackbone=LLaMA3.1-8B-IT2026.01 | 24.8 | 80.4 | 52.6 | |
| LLM-TRSRBackbone=Qwen2.5-7B-IT2026.01 | 24.4 | 17.6 | 21 | |
| LLM-TRSR + FPPS-MBackbone=Qwen2.5-7B-IT2026.01 | 24 | 85.2 | 54.6 | |
| LLM-TRSRBackbone=Qwen2.5-14B-IT2026.01 | 23.6 | 25.6 | 24.6 | |
| LLM-TRSR + FPPS-SBackbone=Qwen2.5-14B-IT2026.01 | 23.6 | 28 | 25.8 | |
| LLM-TRSR + FPPS-MBackbone=Qwen2.5-14B-IT2026.01 | 22.8 | 58 | 40.4 | |
| LLM-TRSR + FPPS-HBackbone=Qwen2.5-14B-IT2026.01 | 22.4 | 58 | 40.2 | |
| LLM-TRSR + FPPS-HBackbone=Qwen2.5-7B-IT2026.01 | 22 | 85.6 | 53.8 | |
| LLM-TRSR + FPPS-HBackbone=LLaMA3.1-8B-IT2026.01 | 18.4 | 80.8 | 49.6 |