MovieChat
Benchmarks
TaskDatasetSOTA resultTrendResults
MovieChat
34.04Throughput (Tokens/s)
24
MovieChat-1k Breakpoint
74.72Accuracy
23
MovieChat Global Breakpoint
74.72Breakpoint Accuracy
14
MovieChat long video 1K (test)
3.11CI Score
11
MovieChat-1K Global mode
93.1Accuracy
10
MovieChat 1K (test)
86.8Accuracy
7
MovieChat-1K Global Mode
3.28Correctness of Information
7
MovieChat1k
79Accuracy
6
MovieChat-1k Global
84.9Accuracy
6
MovieChat-1K
80.6Accuracy
5
MovieChat-1K Breakpoint mode
48.3Accuracy
5
MovieChat-1K Global mode
62.3Accuracy
5
MovieChat (test)
95.3Accuracy
4
MovieChat-1K breakpoint mode 1.0
2.64CI
4
MovieChat-1K
4.27ROUGE-2
3
MovieChat-1K
55.51Accuracy
2
MovieChat-1K Global mode (test)
—Accuracy
0