List your company

Question Answering on ARC (Accuracy vs Speedup Tradeoff)

75.1AccuracySimExit
70.21271.48172.7574.019Jul 23, 2025

Evaluation results

MethodLinks
SimExitModel=Vicuna-7B, Best Th=0.80, Th @≤1pp Drop=0.602025.0775.11.41751.52
SimExitModel=LLaMA-7B, Best Th=3.80, Th @≤1pp Drop=3.802025.0770.41.1670.41.16