Video Topic Segmentation on CLVTS (test)
39.98F1 ScoreMMVTS Co-Attn with MoE
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MMVTS Co-Attn with MoEPT=true, FT-Coh=true, Modality=V+T2024.08 | 39.98 | 58.96 | 51.41 | 54.71 | 51.27 | |
| MMVTS Merge-Attn with MoEPT=true, FT-Coh=true, Modality=V+T2024.08 | 38.77 | 61.05 | 51.1 | 54.41 | 51.33 | |
| MMVTS Co-AttnPT=true, FT-Coh=true, Modality=V+T2024.08 | 38.49 | 57.23 | 50.59 | 54.47 | 50.2 | |
| MMVTS Merge-AttnPT=true, FT-Coh=true, Modality=V+T2024.08 | 38.17 | 55.52 | 50.69 | 54.84 | 49.8 | |
| MMVTS Baseline1PT=false, FT-Coh=false, Modality=V+T2024.08 | 37.32 | 49.75 | 47.07 | 50.51 | 46.16 | |
| MMVTS Baseline2PT=false, FT-Coh=true, Modality=V+T2024.08 | 37.29 | 48.48 | 47.62 | 51.73 | 46.28 | |
| MMVTS Baseline3PT=true, FT-Coh=true, Modality=V+T2024.08 | 36.54 | 50.67 | 48.81 | 52.56 | 47.15 | |
| LongFormer_csslModality=T2024.08 | 34.77 | 53.07 | 47.51 | 53.15 | 47.12 | |
| SWST_seqModality=V+T2024.08 | 34.55 | 52.77 | 48.08 | 52.67 | 47.02 | |
| LongFormerModality=T2024.08 | 34.42 | 52.19 | 47.77 | 52.87 | 46.81 | |
| Llama-3-8B DiscreteModality=T2024.08 | 31.47 | 60.4 | 54.64 | 58.86 | 51.34 | |
| Llama-3-8B GenerativeModality=T2024.08 | 27.5 | 40.58 | 43.71 | 50.38 | 40.54 |