List your company

Mathematical Reasoning on MATH (Throughput Metrics)

237.96Throughput (tokens/s)EAGLE-2(+FR 32k)
83.8216123.8383163.855203.8717Feb 20, 2025

Evaluation results

MethodLinks
EAGLE-2(+FR 32k)Backbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation, Feature=FR 32k2025.02237.962.65
EAGLE-2Backbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation2025.02196.342.19
VanillaBackbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation2025.0289.751