Quranic passage retrieval on Expanded Quran QA dataset
0.5018MAP@10AraColBERT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AraColBERTMethod Type=Dense-only2026.06 | 0.5018 | 0.5527 | 0.5976 | |
| Stage 4: + Generative Refinement [Full]Pipeline Phase=Full Pipeline, Backbone=AraT52026.06 | 0.4947 | 0.5807 | 0.7024 | |
| AraBERT-baseConfiguration=Fine-Tuned2026.06 | 0.36 | 0.59 | 0.5 | |
| CAMeLBERT-BaseConfiguration=Fine-Tuned2026.06 | 0.34 | 0.47 | 0.4 | |
| AraELECTRA-BaseConfiguration=Fine-Tuned2026.06 | 0.33 | 0.45 | 0.57 | |
| Stage 2: Hybrid Candidate RetrievalPipeline Phase=Ablation Study2026.06 | 0.2585 | 0.3311 | 0.5571 | |
| AraBERT-baseConfiguration=Standard Baseline2026.06 | 0.22 | 0.37 | 0.3 | |
| Stage 3: + Neural Semantic RerankingPipeline Phase=Ablation Study2026.06 | 0.2039 | 0.2643 | 0.4071 | |
| mE5 MultilingualMethod Type=Dense2026.06 | 0.1604 | 0.2057 | 0.3357 | |
| BM25-onlyMethod Type=Sparse2026.06 | 0.0831 | 0.1097 | 0.1667 |