Dependency Parsing on Orféo (test)
0WERTEXT SEQ2LABEL
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TEXT SEQ2LABELModality=Text, Architecture=Seq2Label, Parameters=110M + 39.2M, Pre-training=CamemBERT2024.06 | 0 | 0 | 96.9 | 88.8 | 85.7 | |
| TEXT GRAPHModality=Text, Architecture=Graph, Parameters=110M + 41.4M, Pre-training=CamemBERT2024.06 | 0 | 0 | 95.1 | 87.4 | 84 | |
| TEXT HOPSModality=Text, Architecture=Hops, Parameters=110M + 100M, Pre-training=CamemBERT2024.06 | 0 | 0 | 98.2 | 90.3 | 87.7 | |
| AUDIO GRAPHModality=Audio, Architecture=Graph, Parameters=315M + 34.9M, Pre-training=Wav2vec22024.06 | 35.6 | 22.1 | 73.1 | 66 | 60.9 | |
| ORACLE GRAPHModality=Oracle, Architecture=Graph, Parameters=315M + 34.9M, Pre-training=Wav2vec22024.06 | 35.6 | 22.2 | 77.4 | 73.3 | 67.5 | |
| PIPELINE SEQ2LABELModality=Pipeline, Architecture=Seq2Label, Parameters=314M + 110M + 39.2M, Pre-training=Wav2vec2 + CamemBERT2024.06 | 35.6 | 22 | 70.8 | 63.8 | 58.4 | |
| PIPELINE GRAPHModality=Pipeline, Architecture=Graph, Parameters=314M + 110M + 41.4M, Pre-training=Wav2vec2 + CamemBERT2024.06 | 35.6 | 22 | 69.3 | 60.5 | 53.1 | |
| PIPELINE HOPSModality=Pipeline, Architecture=Hops, Parameters=314M + 110M + 100M, Pre-training=Wav2vec2 + CamemBERT2024.06 | 35.6 | 22 | 72.4 | 65.8 | 61 | |
| AUDIO SEQ2LABELModality=Audio, Architecture=Seq2Label, Parameters=315M + 34.9M, Pre-training=Wav2vec22024.06 | 35.9 | 22.3 | 73 | 65.7 | 60.4 | |
| ORACLE SEQ2LABELModality=Oracle, Architecture=Seq2Label, Parameters=315M + 34.9M, Pre-training=Wav2vec22024.06 | 36.3 | 22.2 | 75.6 | 68.7 | 62.7 |