Text Classification on FPB
92.5AccuracySC
Evaluation Results
| Method | Links | |
|---|---|---|
| SCModel=Mistral, Shots=42025.05 | 92.5 | |
| Base LLMModel=Mistral, Shots=42025.05 | 90.47 | |
| SCModel=Mistral, k-shot=8, Seeds=52025.05 | 89.53 | |
| CCModel=Mistral, Shots=42025.05 | 87.34 | |
| BCModel=Mistral, Shots=42025.05 | 87.19 | |
| BCModel=Llama, Shots=42025.05 | 86.99 | |
| SCModel=Llama, k-shot=8, Seeds=52025.05 | 86.95 | |
| DCModel=Mistral, k-shot=8, Seeds=52025.05 | 86.64 | |
| SCModel=Llama, Shots=42025.05 | 86.29 | |
| Latent Concept LearningBackbone=GPT2-large, Configuration=concept tokens as prefixes2023.01 | 86.1 | |
| DCModel=Llama, Shots=42025.05 | 85.94 | |
| Base LLMModel=Mistral, k-shot=8, Seeds=52025.05 | 85.86 | |
| DCModel=Mistral, Shots=42025.05 | 85.86 | |
| CCModel=Llama, Shots=42025.05 | 85.51 | |
| CCModel=Mistral, k-shot=8, Seeds=52025.05 | 84.61 | |
| Base LLMModel=Llama, k-shot=8, Seeds=52025.05 | 84.14 | |
| DCModel=Llama, k-shot=8, Seeds=52025.05 | 84.06 | |
| BCModel=Mistral, k-shot=8, Seeds=52025.05 | 83.91 | |
| BCModel=Llama, k-shot=8, Seeds=52025.05 | 83.44 | |
| CCModel=Llama, k-shot=8, Seeds=52025.05 | 82.73 | |
| Base LLMModel=Llama, Shots=42025.05 | 78.55 | |
| BCModel=Qwen, Shots=42025.05 | 76.64 | |
| SCModel=Qwen, k-shot=8, Seeds=52025.05 | 76.33 | |
| SCModel=Qwen, Shots=42025.05 | 74.69 | |
| BCModel=Qwen, k-shot=8, Seeds=52025.05 | 70.7 | |
| Base LLMModel=Qwen, Shots=42025.05 | 63.36 | |
| Base LLMModel=Qwen, k-shot=8, Seeds=52025.05 | 62.58 | |
| DCModel=Qwen, Shots=42025.05 | 52.73 | |
| CCModel=Qwen, Shots=42025.05 | 50.94 | |
| CCModel=Qwen, k-shot=8, Seeds=52025.05 | 33.28 | |
| DCModel=Qwen, k-shot=8, Seeds=52025.05 | 33.13 |