Clip
Benchmarks
TaskDatasetSOTA resultTrendResults
CLIP benchmark (test)
93Accuracy
72
CLIP prompt-escalation (val)
0.337True Deferral-Advice Loss
66
CLIP
88.7F1 Score
56
CLIP image-text (train)
91.68Precision
36
CLIP 20-task suite
93.1Average Top-1 Accuracy
24
CLIP 14-task suite
92.8Average Top-1 Accuracy
24
Clip 128K
52Accuracy
18
CLIP Zero-shot Evaluation Suite (10 datasets)
89.6Cars Accuracy
16
CLIP
2.15Speedup
14
CLIP 8-task suite
94.3Average Top-1 Accuracy
12
CLIP
2.15Latency (ms)
12
CLIP (test)
80.9Micro F1
12
CLIP Classification Suite
97.2CIFAR-10 Accuracy
11
CLIP 21-dataset Zero-Shot standard (test val)
45ImageNet Accuracy
11
CLIP
86.6Binary F1 Score
7
CLIP CL
14.86BWT
6
7000 clip Short Segments (test)
0.042Clarity
6
CLIP 200 random samples (test)
0.24Macro F1 Score
6
Clip
70.1Precision
4
Clip
93.3Precision (P)
4
CLIP (evaluation)
27.07RMSE (%)
3
CLIP (val)
27.13RMSE (%)
3
Clip300 sigma=60
25.51Average PSNR (dB)
3
Clip300 sigma=15
31.68Average PSNR (dB)
3
CLIP Multi-shot Downstream
70.27BA
2