List your company
ResearchFormerly WizWand

Mathematical Reasoning on GSM8K (Acceptance Rate & Speedup Ratio)

79.3Acceptance RateGSD
59.33264.51669.774.884Jul 23, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GSDTarget Model=OPT-13b, Draft Model=OPT-350m, k (maximum out-degree)=4, tau (redundant node threshold)=1, theta_prob=0.4, theta_sib=0.1, Decoding Setting=Deterministic2024.0779.31.22
GSDTarget Model=LLaMA-2-7b, Draft Model=LLaMA-160m, k=4, tau=1, theta_prob=0.4, theta_sib=0.12024.0779.31.16
TSDTarget Model=LLaMA-2-7b, Draft Model=LLaMA-160m, k=4, tau=1, theta_prob=0.4, theta_sib=0.12024.0777.50.6
TSDTarget Model=OPT-13b, Draft Model=OPT-350m, k (maximum out-degree)=4, tau (redundant node threshold)=1, theta_prob=0.4, theta_sib=0.1, Decoding Setting=Deterministic2024.07770.62
GSDTarget Model=BLOOM-7b1, Draft Model=BLOOM-560m, k (maximum out-degree)=4, tau (threshold for redundant node)=1, theta_prob=0.4, theta_sib=0.12024.0775.51.26
TSDTarget Model=BLOOM-7b1, Draft Model=BLOOM-560m, k (maximum out-degree)=4, tau (threshold for redundant node)=1, theta_prob=0.4, theta_sib=0.12024.0774.10.32
SSDTarget Model=BLOOM-7b1, Draft Model=BLOOM-560m, k (maximum out-degree)=4, tau (threshold for redundant node)=1, theta_prob=0.4, theta_sib=0.12024.0765.31.18
SSDTarget Model=OPT-13b, Draft Model=OPT-350m, k (maximum out-degree)=4, tau (redundant node threshold)=1, theta_prob=0.4, theta_sib=0.1, Decoding Setting=Deterministic2024.0760.21.08
SSDTarget Model=LLaMA-2-7b, Draft Model=LLaMA-160m, k=4, tau=1, theta_prob=0.4, theta_sib=0.12024.0760.11.04