ResearchBenchmarksBinary Classification on MCP tool descriptions (test)Follow100AccuracyBERT54.593666.381878.1789.9582Apr 12, 2026Evaluation ResultsMethodMethodLinksAccuracyPrecisionRecallF1 ScoreBERTTuning=Fine-tunedTuning=Fine-tuned2026.04100100100100SVCTuning=Fine-tunedTuning=Fine-tuned2026.04100100100100BiLSTMTuning=Fine-tunedTuning=Fine-tuned2026.04100100100100YARAModel type=Rule-based...Model type=Rule-based detection system2026.0469.0162.520.8331.25BERTTuning=Untuned, Pre-tr...Tuning=Untuned, Pre-trained weights=bert-base-uncased2026.0456.3411.114.176.06