MagicBrush
Benchmarks
TaskDatasetSOTA resultTrendResults
MagicBrush (test)
0.928CLIP Image
53
MagicBrush
81.95F1 Score
21
MagicBrush
91.1CLIPim
19
MagicBrush
8.14GPT-4o Score
18
MagicBrush
0.322CLIP-T Score
15
MagicBrush single-turn (test)
0.933CLIP Similarity (Image)
13
MagicBrush 1.0 (test)
0.911CLIP Image Similarity
12
MagicBrush (dev)
0.046L1 Error
12
MagicBrush
4.2IR Score
12
MagicBrush Single-Turn
0.033L1 Loss
11
MagicBrush
89.9F1 Score
10
MagicBrush Multi-turn (test)
0.091L1 Loss
10
MagicBrush
90.1Accuracy
9
MagicBrush AURORA-BENCH
6.71GPT-4o Score
9
MagicBrush
0.064L1 Loss
9
MagicBrush (test)
0.06L1 Error
9
MagicBrush
0.931CLIP Score
7
MagicBrush v1 (test)
0.898CLIP Input Similarity
7
MagicBrush Multi-Turn
0.035L1 Loss
7
MagicBrush multi-turn (test)
0.313CLIP-T
7
MagicBrush (test)
50Main Difference Count
7
MagicBrush (test)
73.7Accuracy
7
MagicBrush
0.045LPIPS-U
6
MagicBrush All Turn (test)
0.043L1 Loss
4
MagicBrush Final Turn (test)
0.075L1
4