VL-MIA
Benchmarks
TaskDatasetSOTA resultTrendResults
VL-MIA Flickr (test)
0.999AUC
149
VL-MIA DALL·E
89.1AUROC
120
VL-MIA Flickr 2k
0.814AUC
45
VL-MIA Flickr v1 (test)
0.812AUC
45
VL-MIA TEXT
78.2Accuracy
33
VL-MIA Text LLaMA Adapter TEXTLEN=64
77.8AUC
21
VL-MIA Text LLaMA Adapter TEXTLEN=32
82.8AUC
21
VL-MIA Text MiniGPT-4 TEXTLEN=64
89.1AUC
21
VL-MIA Text MiniGPT-4 TEXTLEN=32
82.4AUC
21
VL-MIA Text LLaVA TEXTLEN=64
0.994AUC
21
VL-MIA Text LLaVA TEXTLEN=32
81AUC
21
VL-MIA TEXT
96.3Accuracy
18
VL-MIA Flickr
0.793AUC
15
VL-MIA Flickr (test)
0.736AUC
15
VL-MIA DALL-E (test)
81.5AUC
14
VL-MIA DALL-E 1.0 (test)
8.1TPR@5%FPR (Aug_KL)
11
VL-MIA Flickr 1.0 (test)
8TPR@5%FPR (Aug_KL)
11