Intent Classification on MPGT
83.04Macro F1Drop
Evaluation results
| Method | Links | |
|---|---|---|
| DropLLM=Llama-3 8B, n-shot=5, Embedding Model=BGE2026.01 | 83.04 | |
| DropLLM=Mistral 7B, n-shot=5, Embedding Model=BGE2026.01 | 81.27 | |
| DropLLM=Mistral 7B, n-shot=5, Embedding Model=MPNet2026.01 | 79.25 | |
| Dis-1LLM=Llama-3 8B, n-shot=2, Embedding Model=MiniLM2026.01 | 73.04 | |
| DropLLM=Llama-3 8B, n-shot=2, Embedding Model=BGE2026.01 | 72.73 | |
| DropLLM=Llama-3 8B, n-shot=2, Embedding Model=MPNet2026.01 | 72.16 | |
| Dis-3LLM=Mistral 7B, n-shot=2, Embedding Model=MPNet2026.01 | 72.05 | |
| Dis-2LLM=Mistral 7B, n-shot=2, Embedding Model=BGE2026.01 | 68.36 |