Gap Detection on GAPBENCH (test)
87.7F1 ScoreCOMPLIANCENLP
Evaluation results
| Method | Links | |
|---|---|---|
| COMPLIANCENLPRetrieval=With retrieval2026.04 | 87.7 | |
| COMPLIANCENLP w/o MiniCheckRetrieval=With retrieval2026.04 | 87.2 | |
| LLaMA-3-70B*Retrieval=With retrieval2026.04 | 86.3 | |
| COMPLIANCENLP w/o multi-taskRetrieval=With retrieval2026.04 | 84.9 | |
| GPT-4o + RAGRetrieval=With retrieval2026.04 | 84.2 | |
| LLaMA-3-8B + RAGRetrieval=With retrieval2026.04 | 83.5 | |
| COMPLIANCENLP w/o KG rerankingRetrieval=With retrieval2026.04 | 83.1 | |
| GPT-4 + RAGRetrieval=With retrieval2026.04 | 82.9 | |
| GPT-4oRetrieval=Without retrieval, Prompting=5-shot2026.04 | 81.4 | |
| GPT-4Retrieval=Without retrieval, Prompting=5-shot2026.04 | 79.8 | |
| LEGAL-BERTRetrieval=Without retrieval2026.04 | 71.3 | |
| FinBERTRetrieval=Without retrieval2026.04 | 68.1 |