Metric alignment with human understandability judgements on Synthetics BSL
0.85Pearson rSignCLIP - BSL sentence
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SignCLIP - BSL sentenceMetric configuration=pose-to-pose (p2p), Requirement=Reference-based (source sequence)2026.06 | 0.85 | 0.9 | |
| SignCLIP - Multilingual segmentationMetric configuration=pose-to-pose (p2p), Requirement=Reference-based (source sequence)2026.06 | 0.83 | 0.7 | |
| SignCLIP - BSL segmentationMetric configuration=pose-to-pose (p2p), Requirement=Reference-based (source sequence)2026.06 | 0.75 | 0.7 | |
| BT2 FidelityCategory=Per-component2026.06 | 0.74 | 0.94 | |
| SignCLIP - Multilingual sentenceMetric configuration=pose-to-pose (p2p), Requirement=Reference-based (source sequence)2026.06 | 0.7 | 0.7 | |
| BT2 PhonologyCategory=Per-component2026.06 | 0.48 | 0.26 | |
| SVAERequirement=Reference-based (source sequence)2026.06 | 0.43 | 0.26 | |
| BT2 OverallRequirement=Reference-free (source text)2026.06 | 0.42 | 0.6 | |
| BT2 FluencyCategory=Per-component2026.06 | 0.21 | 0.37 | |
| SiBLEURequirement=Reference-based (source sequence)2026.06 | 0.03 | 0.31 | |
| SignCLIP - BSL sentenceMetric configuration=pose-to-text (p2t), Requirement=Reference-free (source text)2026.06 | 0.03 | 0.3 | |
| DTW-MPJPERequirement=Reference-based (source sequence)2026.06 | -0.14 | -0.03 | |
| ChrFRequirement=Reference-free (source text)2026.06 | -0.27 | -0.09 | |
| SignCLIP - BSL segmentationMetric configuration=pose-to-text (p2t), Requirement=Reference-free (source text)2026.06 | -0.33 | -0.3 | |
| ROUGERequirement=Reference-free (source text)2026.06 | -0.34 | -0.44 | |
| BLEURTRequirement=Reference-free (source text)2026.06 | -0.35 | 0.03 | |
| SignCLIP - Multilingual segmentationMetric configuration=pose-to-text (p2t), Requirement=Reference-free (source text)2026.06 | -0.37 | -0.1 | |
| BLEU-4Requirement=Reference-free (source text)2026.06 | -0.38 | -0.44 | |
| BT2 GrammarCategory=Per-component2026.06 | -0.5 | -0.14 | |
| SignCLIP - Multilingual sentenceMetric configuration=pose-to-text (p2t), Requirement=Reference-free (source text)2026.06 | -0.64 | -0.6 |