Periodic Question Answering on RotNIST-QA
1.5MAEPeriod-LLM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Period-LLMLLM=LLaMA-7B, Evaluation Protocol=Fine-tune2025.05 | 1.5 | 2.75 | |
| Video-ChatGPTLLM=Vicuna-7B, Evaluation Protocol=Fine-tune2025.05 | 2.01 | 2.29 | |
| VideoChatLLM=Vicuna-7B, Evaluation Protocol=Fine-tune2025.05 | 2.23 | 3.06 | |
| LLaMA-VIDLLM=Vicuna-7B, Evaluation Protocol=Fine-tune2025.05 | 2.43 | 3.25 | |
| VideoLLaMALLM=Vicuna-7B, Evaluation Protocol=Fine-tune2025.05 | 2.51 | 3.89 | |
| LLaMA-AdapterLLM=LLaMA-7B, Evaluation Protocol=Fine-tune2025.05 | 2.66 | 3.23 | |
| BT-AdapterLLM=Vicuna-7B, Evaluation Protocol=Fine-tune2025.05 | 2.78 | 3.56 | |
| FrozenBiLMLLM=DeBERTa-V2, Evaluation Protocol=Fine-tune2025.05 | 2.88 | 3.25 | |
| Period-LLMLLM=LLaMA-7B, Evaluation Protocol=Zero-shot2025.05 | 3.2 | 3.96 | |
| Video-ChatGPTLLM=Vicuna-7B, Evaluation Protocol=Zero-shot2025.05 | 3.44 | 4.87 | |
| VideoChatLLM=Vicuna-7B, Evaluation Protocol=Zero-shot2025.05 | 3.56 | 4.21 | |
| LLaMA-VIDLLM=Vicuna-7B, Evaluation Protocol=Zero-shot2025.05 | 3.87 | 4.57 | |
| LLaMA-AdapterLLM=LLaMA-7B, Evaluation Protocol=Zero-shot2025.05 | 3.95 | 4.42 | |
| BT-AdapterLLM=Vicuna-7B, Evaluation Protocol=Zero-shot2025.05 | 4.03 | 5.46 | |
| VideoLLaMALLM=Vicuna-7B, Evaluation Protocol=Zero-shot2025.05 | 4.08 | 5.32 | |
| FrozenBiLMLLM=DeBERTa-V2, Evaluation Protocol=Zero-shot2025.05 | 4.26 | 4.78 |