Human Correlation Analysis on HATS 70% human agreement split
78.8Correlation RatioSemDist
Evaluation Results
| Method | Links | |
|---|---|---|
| SemDistMetric Granularity=Sentence, Base Metric=Sentence CamemBERT-large2026.05 | 78.8 | |
| minCEDBase Metric=SemDist, Threshold (θ)=0.0095, Metric Granularity=Character2026.05 | 68.2 | |
| minCEDBase Metric=SemDist, Threshold (θ)=0.001, Metric Granularity=Character2026.05 | 67.1 | |
| Character Error Rate2026.05 | 64.1 | |
| minWEDBase Metric=SemDist, Threshold (θ)=0.024, Metric Granularity=Word2026.05 | 54.6 | |
| Word Error Rate2026.05 | 53.6 | |
| minWEDBase Metric=SemDist, Threshold (θ)=0.004, Metric Granularity=Word2026.05 | 53.5 | |
| minCEDBase Metric=SemDist, Threshold (θ)=0.39, Metric Granularity=Character2026.05 | 29.5 | |
| minWEDBase Metric=SemDist, Threshold (θ)=0.4, Metric Granularity=Word2026.05 | 22.2 |