List your company
ResearchFormerly WizWand

Inference Throughput on NQ for Hallucination Detection

5,224Throughput (Samples/sec)Mean Pooling
-208.8561,201.5972,612.054,022.503May 9, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Mean PoolingModel=LLaMA-3.1-8B2026.055,224
Max PoolingModel=LLaMA-3.1-8B2026.054,992
HaMI (Original)Model=LLaMA-3.1-8B2026.054,096
Max PoolingModel=Mistral-Nemo-Instruct (12B)2026.053,720
Mean PoolingModel=Mistral-Nemo-Instruct (12B)2026.053,706
HaMI (Original)Model=Mistral-Nemo-Instruct (12B)2026.052,886
Mean PoolingModel=LLaMA-3.3-Instruct-70B2026.052,625
Max PoolingModel=LLaMA-3.3-Instruct-70B2026.052,602
HaMI (Original)Model=LLaMA-3.3-Instruct-70B2026.052,315
HaMI (SP)Model=Mistral-Nemo-Instruct (12B)2026.050.22
HaMI (SP)Model=LLaMA-3.3-Instruct-70B2026.050.18
HaMI (SP)Model=LLaMA-3.1-8B2026.050.1