General
Benchmarks
TaskDatasetSOTA resultTrendResults
General Alignment and Coherence
93.52Alignment Score
18
general 2023 (test)
32.64BLEU
16
General Inference Speed Evaluation Images
31.7FPS
16
General
13.24FID (General)
13
General (train)
1Relative Cost
12
General (MMLU, BBH, TyDiQA, BoolQ, PIQA, GSM8K)
55.75General Score
9
General
18.34Parameters (M)
9
General Efficiency Evaluation
7.3Latency (ms)
9
General Architectural Comparison 1.0 (UEIB-T90)
22.82PSNR
8
General
72.4Avg Score
8
General (test)
76.5BERTScore
8
General
32.55Parameters (M)
8
General 300 samples (test)
3.2Latency (µs)
7
General Model Complexity
91,371Parameters
7
General
3.7Params (M)
7
General
2.13CPR
6
General 16 frames, 512 text tokens (inference)
20.74FPS
6
General Efficiency Benchmarking
84.89Parameters (MB)
6
General Architecture Evaluation
0.074Parameters (M)
5
General Theoretical Analysis
1FLOPs per Step
5
General
13.77MFLOPs / Pixel
5
General (test)
0.401MRR
5
General Throughput Evaluation
168.9Throughput (tokens/s)
4
General
—Primary metric
0
General First-order optimization setting
—Primary metric
0