Offer Validation on Regulated Procurement Offer Validation 25 folds N=200 (test)
89.9F1 Score (Positive)LTN
Evaluation Results
| Method | Links | |
|---|---|---|
| LTNFuzzy-Logic=Łukasiewicz2026.04 | 89.9 | |
| LLM (BM25+Semantic-CE) - Qwen2.5:32b2026.04 | 88.4 | |
| MCSR-BestConfFuzzy-Logic=Product2026.04 | 87.4 | |
| BERT2026.04 | 85.9 | |
| MCSR-TopProbFuzzy-Logic=Łukasiewicz2026.04 | 84.9 | |
| LLM (BM25+Semantic-CE) - Qwen2.5:14b-instruct2026.04 | 84.3 | |
| IE + deterministic Rules2026.04 | 80.7 | |
| CISCFuzzy-Logic=Łukasiewicz2026.04 | 78.2 |