Hateful Meme Detection on Hateful Memes (val test)
51.05AccuracyQ-VLM
Evaluation Results
| Method | Links | |
|---|---|---|
| Q-VLMBackbone=OpenFlamingo-3B, Shots=32, Bitwidth=8-bit2024.10 | 51.05 | |
| Floating PointBackbone=OpenFlamingo-3B, Shots=32, Bitwidth=FP2024.10 | 50.27 | |
| Floating PointBackbone=OpenFlamingo-3B, Shots=0, Bitwidth=FP2024.10 | 50.23 | |
| Floating PointBackbone=OpenFlamingo-3B, Shots=4, Bitwidth=FP2024.10 | 50.1 | |
| Q-LoRABackbone=OpenFlamingo-3B, Shots=32, Bitwidth=8-bit2024.10 | 50.02 | |
| Q-VLMBackbone=OpenFlamingo-3B, Shots=4, Bitwidth=8-bit2024.10 | 49.55 | |
| Q-VLMBackbone=OpenFlamingo-3B, Shots=0, Bitwidth=8-bit2024.10 | 49.12 | |
| Q-LoRABackbone=OpenFlamingo-3B, Shots=4, Bitwidth=8-bit2024.10 | 48.62 | |
| Q-VLMBackbone=OpenFlamingo-3B, Shots=32, Bitwidth=4-bit2024.10 | 47.84 | |
| Q-LoRABackbone=OpenFlamingo-3B, Shots=0, Bitwidth=8-bit2024.10 | 47.75 | |
| Q-LoRABackbone=OpenFlamingo-3B, Shots=32, Bitwidth=4-bit2024.10 | 45.76 | |
| Q-VLMBackbone=OpenFlamingo-3B, Shots=4, Bitwidth=4-bit2024.10 | 45.26 | |
| Q-LoRABackbone=OpenFlamingo-3B, Shots=4, Bitwidth=4-bit2024.10 | 45.12 | |
| Q-VLMBackbone=OpenFlamingo-3B, Shots=0, Bitwidth=4-bit2024.10 | 44.22 | |
| Q-LoRABackbone=OpenFlamingo-3B, Shots=0, Bitwidth=4-bit2024.10 | 43.86 |