Visual Question Answering on GQA (Score and Relative Performance %)
100Relative PerformanceOriginal
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OriginalPrecision (Pre.)=FP16, Keep Ratio=100%, GFLOPs=100.00%2026.04 | 100 | 60.65 | |
| AWQPrecision (Pre.)=W4A16, Keep Ratio=100%, GFLOPs=100.00%2026.04 | 100 | — | |
| GPTQPrecision (Pre.)=W4A16, Keep Ratio=100%, GFLOPs=100.00%2026.04 | 99.34 | — | |
| Quant.Precision (Pre.)=W4A4, Keep Ratio=100%, GFLOPs=100.00%2026.04 | 91.76 | 55.65 | |
| LUQPrecision (Pre.)=W2.75A16, Keep Ratio=100%, GFLOPs=100.00%2026.04 | 87.44 | — | |
| FastVPrecision (Pre.)=FP16, Keep Ratio=30%, GFLOPs=32.66%2026.04 | 87.09 | — | |
| DivPrunePrecision (Pre.)=FP16, Keep Ratio=25%, GFLOPs=24.45%2026.04 | 82.95 | — | |
| PDropPrecision (Pre.)=FP16, Keep Ratio=30%, GFLOPs=33.03%2026.04 | 82.62 | — | |
| PruningPrecision (Pre.)=FP16, Keep Ratio=30%, GFLOPs=55.80%2026.04 | 81.29 | 49.3 | |
| QUOTAPrecision (Pre.)=W4A4, Keep Ratio=30%, GFLOPs=55.80%2026.04 | 78.76 | 47.77 | |
| VTWPrecision (Pre.)=FP16, Keep Ratio=40%, GFLOPs=43.43%2026.04 | 66.56 | — |