Interactive Video Feedback Generation on QEVD-FIT-COACH
0.127METEORSTREAM-VLM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| STREAM-VLMFine-tuned on QEVD=true2024.07 | 0.127 | 0.112 | 0.863 | 2.45 | 0.56 | |
| STREAM-VLM (w/o Action-Tokens)Fine-tuned on QEVD=true, Action-Tokens=false, Evaluation mode=non-interactive (evaluated at regular intervals)2024.07 | 0.125 | 0.11 | 0.861 | 2.41 | 0.5 | |
| Video-ChatGPTFine-tuned on QEVD=true, Fine-tuned by=ourselves, Evaluation mode=non-interactive (evaluated at regular intervals)2024.07 | 0.108 | 0.093 | 0.863 | 2.33 | 0.5 | |
| LLaMA-VIDFine-tuned on QEVD=true, Fine-tuned by=ourselves, Evaluation mode=non-interactive (evaluated at regular intervals)2024.07 | 0.106 | 0.09 | 0.86 | 2.3 | 0.5 | |
| STREAM-VLM (w/o Pre-training)Fine-tuned on QEVD=true, Pre-training=false2024.07 | 0.095 | 0.087 | 0.858 | 2.08 | 0.52 | |
| Socratic-LLaMA-2-7BFine-tuned on QEVD=true, Evaluation mode=non-interactive (evaluated at regular intervals)2024.07 | 0.094 | 0.071 | 0.86 | 2.17 | 0.5 | |
| STREAM-VLM (w/o 3D CNN)Fine-tuned on QEVD=true, 3D CNN=false2024.07 | 0.09 | 0.083 | 0.857 | 2.11 | 0.51 |