Named Entity Recognition on REGOBLIGATION (test)
91.3F1 ScoreCOMPLIANCENLP
Evaluation results
| Method | Links | |
|---|---|---|
| COMPLIANCENLPRetrieval=With retrieval, Full components=true2026.04 | 91.3 | |
| COMPLIANCENLP w/o MiniCheckRetrieval=With retrieval, MiniCheck verification=false2026.04 | 91 | |
| LLaMA-3-70B*Retrieval=With retrieval, Status=Teacher (pre-distillation, full RAG)2026.04 | 90.2 | |
| COMPLIANCENLP w/o multi-taskRetrieval=With retrieval, Multi-task training=false2026.04 | 89.1 | |
| GPT-4o + RAGRetrieval=With retrieval, Config=Hybrid retrieval without KG/multi-task/MiniCheck2026.04 | 88.6 | |
| COMPLIANCENLP w/o KG rerankingRetrieval=With retrieval, KG reranking=false2026.04 | 88.4 | |
| LLaMA-3-8B + RAGRetrieval=With retrieval, Status=Distilled student2026.04 | 87.9 | |
| GPT-4 + RAGRetrieval=With retrieval, Config=Hybrid retrieval without KG/multi-task/MiniCheck2026.04 | 87.4 | |
| GPT-4oRetrieval=Without retrieval, Prompting=5-shot2026.04 | 85.9 | |
| GPT-4Retrieval=Without retrieval, Prompting=5-shot2026.04 | 84.7 | |
| LEGAL-BERTRetrieval=Without retrieval2026.04 | 82.1 | |
| FinBERTRetrieval=Without retrieval2026.04 | 76.4 |