Question Classification on TREC (Macro-F1)
72.75Macro-F1BC
Evaluation Results
| Method | Links | |
|---|---|---|
| BCModel=Qwen, k-shot=162025.05 | 72.75 | |
| SCModel=Qwen, k-shot=162025.05 | 69.91 | |
| CCModel=Qwen, k-shot=162025.05 | 69.4 | |
| BCModel=Qwen, Shots=8-shot2025.05 | 67.98 | |
| CCModel=Qwen, Shots=8-shot2025.05 | 63.3 | |
| SCModel=Mistral, k-shot=162025.05 | 62.5 | |
| SCModel=Llama, k-shot=162025.05 | 62.21 | |
| SCModel=Qwen, Shots=8-shot2025.05 | 61.28 | |
| Base LLMModel=Qwen, k-shot=162025.05 | 59.68 | |
| Base LLMModel=Llama, k-shot=162025.05 | 54.93 | |
| SCModel=Mistral, Shots=8-shot2025.05 | 48.57 | |
| Base LLMModel=Mistral, k-shot=162025.05 | 45.48 | |
| Base LLMModel=Qwen, Shots=8-shot2025.05 | 45.4 | |
| Base LLMModel=Llama, Shots=8-shot2025.05 | 44.6 | |
| DCModel=Qwen, k-shot=162025.05 | 44.43 | |
| DCModel=Qwen, Shots=8-shot2025.05 | 43.83 | |
| BCModel=Mistral, k-shot=162025.05 | 41.11 | |
| BCModel=Mistral, Shots=8-shot2025.05 | 40.26 | |
| Base LLMModel=Mistral, Shots=8-shot2025.05 | 40.08 | |
| SCModel=Llama, Shots=8-shot2025.05 | 39.78 | |
| BCModel=Llama, Shots=8-shot2025.05 | 36.22 | |
| DCModel=Mistral, k-shot=162025.05 | 32.79 | |
| BCModel=Llama, k-shot=162025.05 | 32.62 | |
| DCModel=Mistral, Shots=8-shot2025.05 | 30.17 | |
| CCModel=Mistral, k-shot=162025.05 | 28.97 | |
| CCModel=Mistral, Shots=8-shot2025.05 | 27.8 | |
| DCModel=Llama, Shots=8-shot2025.05 | 25.52 | |
| DCModel=Llama, k-shot=162025.05 | 25.52 | |
| CCModel=Llama, Shots=8-shot2025.05 | 24.68 | |
| CCModel=Llama, k-shot=162025.05 | 24.02 |