Inference Efficiency on A100 80 GB GPU
0.019Latency (s)GLiGuard bi-enc
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GLiGuard bi-encParams=145M, Batch Size=1, Hardware=A100 80 GB2026.05 | 0.019 | 54 | |
| GLiGuard uni-encParams=147M, Batch Size=1, Hardware=A100 80 GB2026.05 | 0.02 | 51 | |
| GLiNER2 MultiParams=209M, Batch Size=1, Hardware=A100 80 GB2026.05 | 0.021 | 49 | |
| YuFeng-XGuardParams=8B, Batch Size=1, Hardware=A100 80 GB2026.05 | 0.051 | 20 | |
| WildGuardParams=7B, Batch Size=1, Hardware=A100 80 GB2026.05 | 0.744 | 1.3 |