Turn-taking Naturalness Evaluation on Turn-taking Perturbation Benchmark 1.0 (test)
0.36Delta m_thetaTurnNat (VAP)
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| TurnNat (VAP)Backbone=VAP, Output=256-way cat., Adaptation=FT, alpha=12026.07 | 0.36 | 0.641 | 80.2 | 79.5 | 85 | 82.5 | 74 | 80 | |
| TurnNat (DualTurn)Backbone=DualTurn, Output=indep. Bern. + aux., Adaptation=FT, alpha=12026.07 | 0.4 | 0.657 | 81.5 | 78 | 86 | 92 | 71.5 | 80 | |
| TurnNat (DualTurn)Backbone=DualTurn, Output=256-way cat., Adaptation=FT, alpha=12026.07 | 0.44 | 0.66 | 83.3 | 82 | 90 | 82 | 78 | 84.5 | |
| TurnNat (DualTurn)Backbone=DualTurn, Output=256-way cat. + aux., Adaptation=FT, alpha=12026.07 | 0.45 | 0.67 | 86.2 | 93.5 | 93.5 | 79.5 | 80 | 84.5 | |
| TurnNat (DualTurn)Backbone=DualTurn, Output=256-way cat. + aux., Adaptation=FT, alpha=82026.07 | 0.45 | 0.676 | 88 | 95 | 92.5 | 81 | 84.5 | 87 | |
| TurnNat (DualTurn)Backbone=DualTurn, Output=256-way cat. + aux., Adaptation=FT, alpha=32026.07 | 0.46 | 0.676 | 87.3 | 94 | 92 | 82 | 83.5 | 85 | |
| TurnNat (DualTurn)Backbone=DualTurn, Output=indep. Bern., Adaptation=None2026.07 | 0.47 | 0.645 | 77.5 | 66 | 85 | 83 | 73 | 80.5 | |
| TurnNat (DualTurn)Backbone=DualTurn, Output=indep. Bern., Adaptation=FT, alpha=12026.07 | 0.47 | 0.663 | 81.2 | 75.5 | 82 | 91.5 | 73 | 84 | |
| TurnNat (DualTurn)Backbone=DualTurn, Output=indep. Bern. + aux., Adaptation=FT, alpha=32026.07 | 0.47 | 0.669 | 81.7 | 78.5 | 81.5 | 92 | 75.5 | 81 | |
| TurnNat (VAP)Backbone=VAP, Output=256-way cat., Adaptation=None2026.07 | 0.6 | 0.633 | 80.6 | 90 | 91 | 66 | 82 | 74 |