Question Answering on MeetingBank (test)
76.22QA ScoreLLMLingua-2
Evaluation results
| Method | Links | |
|---|---|---|
| LLMLingua-2Target LLM=Mistral-7B, Tokens=970, Speedup (1/τ)=3.0x2024.03 | 76.22 | |
| LLMLingua-2-smallTarget LLM=Mistral-7B, Tokens=984, Speedup (1/τ)=3.0x2024.03 | 75.97 | |
| Original PromptTarget LLM=Mistral-7B, Tokens=3,0032024.03 | 66.95 | |
| Selective-ContextTarget LLM=Mistral-7B, Tokens=1,222, Speedup (1/τ)=2.5x2024.03 | 58.13 | |
| LLMLinguaTarget LLM=Mistral-7B, Tokens=1,176, Speedup (1/τ)=2.5x2024.03 | 50.45 |