Mathematical Reasoning on GSM8K (Accuracy & Compression Ratio)
14.48AccuracyOriginal Prompt
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Original PromptTarget LLM=LLaMA-2-7B, Evaluation Protocol=In-Context Learning2024.06 | 14.48 | 1 | |
| QGCTarget LLM=LLaMA-2-7B, Evaluation Protocol=In-Context Learning2024.06 | 14.18 | 13.4 | |
| AutoCompressorTarget LLM=LLaMA-2-7B, Evaluation Protocol=In-Context Learning2024.06 | 6.68 | 13.6 | |
| LongLLMLinguaTarget LLM=LLaMA-2-7B, Evaluation Protocol=In-Context Learning2024.06 | 5.91 | 3.9 |