Triplet Prediction on 11 Deliberation Datasets (GSC, Remesh, Polis) (test)
81.8AbGST5-XL + DPT
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ST5-XL + DPTBackbone=ST5-XL, Methodology=DPT2026.05 | 81.8 | 76.4 | 65.9 | 67.5 | 65.6 | 69.5 | 69.8 | 65.1 | 68.4 | 62.5 | 61.9 | 68.6 | |
| ST5-XLBackbone=ST5-XL2026.05 | 81.1 | 70.5 | 69.7 | 65.8 | 61.1 | 69.9 | 60.7 | 57.6 | 56.4 | 55.5 | 69.2 | 65.2 | |
| OAI text-emb-3-largeProvider=OpenAI2026.05 | 79.6 | 74.5 | 56.1 | 63.9 | 61.1 | 71.4 | 58.1 | 57.7 | 51.6 | 50 | 68.1 | 62.9 | |
| ST5-LargeBackbone=ST5-Large2026.05 | 75.5 | 65.5 | 57.2 | 64.6 | 59.9 | 69.2 | 58.8 | 58.1 | 49.9 | 56.8 | 72.2 | 62.5 | |
| BGE-large-enLanguage=English2026.05 | 64.7 | 59.5 | 56.5 | 62.5 | 57.6 | 68 | 54.2 | 55.5 | 53.2 | 52.9 | 66.3 | 59.2 | |
| BGE-SparseCLVariant=arguana2026.05 | 62.4 | 61.7 | 42.7 | 59.2 | 57.2 | 66.1 | 50.1 | 56.1 | 57.5 | 52.6 | 63 | 57.2 | |
| StanceAware-SBERT2026.05 | 58.5 | 58.2 | 36.4 | 64.8 | 59.7 | 68.2 | 68.1 | 56.1 | 52.5 | 52.3 | 68.3 | 58.5 |