Classification on JD.com Query-Product Relevance (test)
0.8682PrecisionBERT-CoT (+RD&DS)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BERT-CoT (+RD&DS)Modules=RD & DS2025.12 | 0.8682 | 0.8556 | 0.8619 | |
| ADORE(+RD&DS&KD)Modules=RD & DS & KD2025.12 | 0.8592 | 0.8498 | 0.8545 | |
| BERT-CoTArchitecture=cross-encoder2025.12 | 0.8535 | 0.8441 | 0.8488 | |
| ADORE(+RD&DS)Modules=RD & DS2025.12 | 0.8488 | 0.8396 | 0.8442 | |
| BERTArchitecture=cross-encoder2025.12 | 0.8421 | 0.8393 | 0.8407 | |
| LLM-Classify2025.12 | 0.8412 | 0.8328 | 0.837 | |
| ADORE(+RD)Modules=RD2025.12 | 0.8261 | 0.8456 | 0.8357 | |
| BERT-MiniArchitecture=cross-encoder2025.12 | 0.811 | 0.8352 | 0.8229 | |
| DSSMArchitecture=bi-encoder2025.12 | 0.7272 | 0.7854 | 0.7552 |