Multi-Evidence Aggregation on Compliance
98AccuracyQwen3-32B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen3-32BNotes=Best LLM, 203× slower2026.03 | 98 | 98 | 79.7 | 3,008.6 | |
| LPF-SPNNotes=Best overall2026.03 | 97.8 | 97.2 | 1.4 | 14.8 | |
| BERTNotes=9.1× slower2026.03 | 97 | 95.2 | 3.2 | 134.7 | |
| Llama-3.3-70BNotes=Severely miscalibrated2026.03 | 95.9 | 95.9 | 81.6 | 1,578.7 | |
| VAE-OnlyNotes=Lacks reasoning2026.03 | 95.6 | 94.8 | 9.6 | 6.9 | |
| LPF-LearnedNotes=Competitive2026.03 | 91.1 | 90.5 | 6.6 | 37.4 | |
| EDL-AggregatedNotes=Fundamental mismatch2026.03 | 42.9 | 44 | 21.4 | 1.1 | |
| EDL-IndividualNotes=Training-inference gap2026.03 | 28.1 | 14.6 | 18.6 | 3.8 | |
| R-GCNNotes=Cannot handle task2026.03 | 15.6 | 9 | 17.8 | 0.0007 |