Intent Classification on Banking77
894.8AccuracyMIC
Evaluation results
| Method | Links | |
|---|---|---|
| MICDimension=1024, Backbone=BGEM32026.05 | 894.8 | |
| MICDimension=512, Backbone=BGEM32026.05 | 890.5 | |
| MRLDimension=1024, Backbone=BGEM32026.05 | 889.7 | |
| MICDimension=256, Backbone=BGEM32026.05 | 888.5 | |
| MRLDimension=512, Backbone=BGEM32026.05 | 886.9 | |
| MRLDimension=256, Backbone=BGEM32026.05 | 884.3 | |
| ESEDimension=1024, Backbone=BGEM32026.05 | 880.3 | |
| ESEDimension=512, Backbone=BGEM32026.05 | 874.8 | |
| MICDimension=128, Backbone=BGEM32026.05 | 870.5 | |
| MRLDimension=128, Backbone=BGEM32026.05 | 863.9 | |
| ESEDimension=256, Backbone=BGEM32026.05 | 862.1 | |
| MICDimension=64, Backbone=BGEM32026.05 | 847.3 | |
| ESEDimension=128, Backbone=BGEM32026.05 | 839.2 | |
| MRLDimension=64, Backbone=BGEM32026.05 | 838.1 | |
| ESEDimension=64, Backbone=BGEM32026.05 | 793.4 | |
| MICDimension=32, Backbone=BGEM32026.05 | 781.7 | |
| MRLDimension=32, Backbone=BGEM32026.05 | 764.2 | |
| MICDimension=16, Backbone=BGEM32026.05 | 661.1 | |
| MRLDimension=16, Backbone=BGEM32026.05 | 643.9 | |
| ESEDimension=16, Backbone=BGEM32026.05 | 626.9 | |
| SPACEApproach Type=Classification-based, Fine-tuning status=fine-tuned on each downstream dataset individually2026.03 | 94.94 | |
| SPACE 2.0Training=Full2023.05 | 94.77 | |
| Llama 2 7BApproach Type=Generation-based, Backbone=Llama 2 7B, Fine-tuning status=FT2026.03 | 94.35 | |
| ConvFiTApproach Type=Classification-based2026.03 | 94.16 | |
| PPTODApproach Type=Generation-based, Fine-tuning status=fine-tuned on each downstream dataset individually2026.03 | 93.86 | |
| Example+ObserverApproach Type=Classification-based2026.03 | 93.83 | |
| ConvBERT+Pre+MultiTraining=Full2023.05 | 93.44 | |
| USE+CONVERTTraining=Full2023.05 | 93.36 | |
| USE+ConvRTApproach Type=Classification-based2026.03 | 93.36 | |
| MRLBackbone=BGEM3, Dim=10242026.04 | 93.11 | |
| MIPICBackbone=BGEM3, Dim=5122026.04 | 92.98 | |
| ConvBERTApproach Type=Classification-based2026.03 | 92.95 | |
| MIPICBackbone=BGEM3, Dim=1282026.04 | 92.94 | |
| MRLBackbone=BGEM3, Dim=5122026.04 | 92.93 | |
| ESAinsTODApproach Type=Generation-based, Backbone=Llama 2 7B2026.03 | 92.89 | |
| MIPICBackbone=BGEM3, Dim=2562026.04 | 92.89 | |
| USETraining=Full2023.05 | 92.81 | |
| MIPICBackbone=BGEM3, Dim=10242026.04 | 92.81 | |
| MRLBackbone=BGEM3, Dim=2562026.04 | 92.71 | |
| TOATODVariant=small, Training=Full2023.05 | 92.4 | |
| ESEBackbone=BGEM3, Dim=10242026.04 | 92.25 | |
| TOATODVariant=base, Training=Full2023.05 | 92.17 | |
| MIPICBackbone=Qwen, Dim=10242026.04 | 92.16 | |
| ESEBackbone=BGEM3, Dim=5122026.04 | 92.13 | |
| MRLBackbone=BGEM3, Dim=1282026.04 | 92.1 | |
| ESEBackbone=BGEM3, Dim=2562026.04 | 92.06 | |
| ESEBackbone=BGEM3, Dim=1282026.04 | 92.02 | |
| Fine-TunedBackbone=RoBERTa-large2025.12 | 92 | |
| ESEBackbone=Qwen, Dim=10242026.04 | 91.98 | |
| MRLBackbone=Qwen, Dim=10242026.04 | 91.81 | |
| BERT-DGTraining=Full2023.05 | 91.75 | |
| MRLBackbone=Qwen, Dim=5122026.04 | 91.61 | |
| ESEBackbone=Qwen, Dim=5122026.04 | 91.42 | |
| MIPICBackbone=Qwen, Dim=5122026.04 | 91.32 | |
| cist-dial (mslm)Training=Full2023.05 | 91.17 | |
| Fixed ICLBackbone=Llama-3.1-8B, Context Length=90k2025.03 | 91 | |
| Linear ProbeBackbone=all-MiniLM-L12-v2, Method (Evaluation Protocol)=Linear Probe2025.12 | 90.9 | |
| MIPICBackbone=BGEM3, Dim=642026.04 | 90.74 | |
| ESEBackbone=BGEM3, Dim=642026.04 | 90.67 | |
| MIPICBackbone=Qwen, Dim=2562026.04 | 90.55 | |
| MRLBackbone=BGEM3, Dim=642026.04 | 90.53 | |
| Ret ICLBackbone=Llama-3.1-8B, Context Length=90k2025.03 | 90 | |
| ESEBackbone=BERT, Dim=7682026.04 | 89.83 | |
| ESEBackbone=Qwen, Dim=2562026.04 | 89.67 | |
| MRLBackbone=Qwen, Dim=2562026.04 | 89.62 | |
| MICBackbone=BERT, Dimension=7682026.05 | 89.61 | |
| MIPICBackbone=BERT, Dim=7682026.04 | 89.45 | |
| MICBackbone=BERT, Dimension=5122026.05 | 89.43 | |
| LDS-PNN-way=10-way, K-shot=5-shot2026.02 | 89.4 | |
| MIPICBackbone=BERT, Dim=5122026.04 | 89.22 | |
| Unsup SimCSEBackbone=BERT, Dim=7682026.04 | 89.15 | |
| Unsup SimCSEBackbone=BERT, Dimension=7682026.05 | 89.15 | |
| ESEBackbone=BERT, Dimension=7682026.05 | 89.14 | |
| DBSABackbone=Llama-3.1-8B, Context Length=90k2025.03 | 89 | |
| Fine-TunedBackbone=all-MiniLM-L12-v2, Method (Evaluation Protocol)=Fine-Tuned2025.12 | 89 | |
| ESEBackbone=BERT, Dim=5122026.04 | 88.93 | |
| ESEBackbone=TinyBERT 6L, Dim=7682026.04 | 88.89 | |
| MIPICBackbone=Qwen, Dim=1282026.04 | 88.84 | |
| AMGSN-way=10-way, K-shot=5-shot2026.02 | 88.8 | |
| MIPICBackbone=TinyBERT 6L, Dim=7682026.04 | 88.76 | |
| ESEBackbone=BERT, Dimension=5122026.05 | 88.51 | |
| DCCLN-way=10-way, K-shot=5-shot2026.02 | 88.5 | |
| MRLBackbone=BERT, Dim=7682026.04 | 88.43 | |
| MRLBackbone=BERT, Dimension=7682026.05 | 88.43 | |
| MICBackbone=TinyBERT 6L, Dimension=7682026.05 | 88.38 | |
| Unsup SimCSEBackbone=BERT, Dim=5122026.04 | 88.34 | |
| Unsup SimCSEBackbone=BERT, Dimension=5122026.05 | 88.34 | |
| Task MatrixBackbone=all-MiniLM-L12-v2, Method (Evaluation Protocol)=Task Matrix, Best Layer=L9,102025.12 | 88.3 | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dim=7682026.04 | 88.29 | |
| ESEBackbone=TinyBERT 6L, Dimension=7682026.05 | 88.24 | |
| MIPICBackbone=TinyBERT 6L, Dim=5122026.04 | 88.15 | |
| MICBackbone=BERT, Dimension=2562026.05 | 88.11 | |
| LaSAMLN-way=10-way, K-shot=5-shot2026.02 | 88.1 | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dimension=7682026.05 | 88.01 | |
| MICBackbone=TinyBERT 6L, Dimension=5122026.05 | 87.93 | |
| ContrastNetN-way=10-way, K-shot=5-shot2026.02 | 87.9 | |
| MRLBackbone=Qwen, Dim=1282026.04 | 87.87 | |
| MRLBackbone=BERT, Dim=5122026.04 | 87.85 | |
| MRLBackbone=BERT, Dimension=5122026.05 | 87.85 | |
| USMoEBackbone=Transformer-XL(20M), Top-k=2, FLOPs=7.7620 x 10^10, Fine-tuning=true2025.03 | 87.8 |