Attribute Clustering on WOAM 1.0 (test)
92.5Jaccard IndexTx-CRF
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Tx-CRFMatch Protocol=Exact Match, Setting=Closed-World (Tagging), Backbone=BERT-Large2023.05 | 92.5 | 95.4 | 95.8 | 20 | 32.8 | |
| Tx-CRFMatch Protocol=Partial Match, Setting=Closed-World (Tagging), Backbone=BERT-Large2023.05 | 78.2 | 85.3 | 86.7 | 30.5 | 44.2 | |
| SU-OpenTagMatch Protocol=Exact Match, Setting=Closed-World (Tagging), Backbone=BERT-Large2023.05 | 70.1 | 78.8 | 87.1 | 22.1 | 34.5 | |
| Amacer*Match Protocol=Exact Match, Setting=Open-World (Segment), Backbone=BERT-Large2023.05 | 69.9 | 78 | 84.1 | 29 | 41.7 | |
| AmacerMatch Protocol=Exact Match, Setting=Open-World (Syntax), Backbone=BERT-Large2023.05 | 67.2 | 76.9 | 84 | 35.7 | 47.6 | |
| OA-MineMatch Protocol=Exact Match, Setting=Open-World (Segment), Backbone=BERT-Large2023.05 | 63.5 | 74.4 | 78.8 | 25.3 | 36.9 | |
| SU-OpenTagMatch Protocol=Partial Match, Setting=Closed-World (Tagging), Backbone=BERT-Large2023.05 | 61.7 | 72.6 | 79.5 | 34.7 | 46.6 | |
| Amacer*Match Protocol=Partial Match, Setting=Open-World (Segment), Backbone=BERT-Large2023.05 | 58.4 | 68.8 | 73.7 | 47.8 | 54.9 | |
| Amacer-RMatch Protocol=Exact Match, Setting=Open-World (Syntax), Backbone=BERT-Large2023.05 | 58.3 | 69.6 | 79.2 | 35.5 | 46.3 | |
| OA-Mine*Match Protocol=Exact Match, Setting=Open-World (Syntax), Backbone=BERT-Large2023.05 | 55.8 | 68.2 | 73.6 | 30.8 | 41.1 | |
| AmacerMatch Protocol=Partial Match, Setting=Open-World (Syntax), Backbone=BERT-Large2023.05 | 52.7 | 63.8 | 70.4 | 57.1 | 59.1 | |
| OA-MineMatch Protocol=Partial Match, Setting=Open-World (Segment), Backbone=BERT-Large2023.05 | 48.8 | 60.9 | 64.9 | 40.5 | 46.7 | |
| Amacer-RMatch Protocol=Partial Match, Setting=Open-World (Syntax), Backbone=BERT-Large2023.05 | 46.3 | 57.6 | 65.8 | 57.7 | 56.9 | |
| OA-Mine*Match Protocol=Partial Match, Setting=Open-World (Syntax), Backbone=BERT-Large2023.05 | 40.6 | 52 | 57.2 | 50.1 | 49.8 | |
| DBSCAN+AEMatch Protocol=Exact Match, Setting=Open-World (Syntax), Backbone=BERT-Large2023.05 | 32.8 | 41.8 | 61.2 | 30.3 | 35.9 | |
| DBSCAN+AEMatch Protocol=Partial Match, Setting=Open-World (Syntax), Backbone=BERT-Large2023.05 | 25.1 | 30.1 | 47.1 | 50.5 | 40.7 | |
| DBSCANMatch Protocol=Exact Match, Setting=Open-World (Syntax), Backbone=BERT-Large2023.05 | 22.4 | 29.8 | 69.5 | 17.3 | 23.6 | |
| DBSCANMatch Protocol=Partial Match, Setting=Open-World (Syntax), Backbone=BERT-Large2023.05 | 20.6 | 24.7 | 60.7 | 26.9 | 30.3 |