Community Question Answering on cQA Apple domain StackExchange (test)
37.8MAP@100MiniLM_S
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MiniLM_SArchitecture=BiEncoder, Framework=Full Model, Specialization=Specialized2026.02 | 37.8 | 41.4 | 41.3 | |
| MiniLM_HoulsbyArchitecture=BiEncoder, Framework=Knowledge Distillation (Oracle), Adapter=Houlsby2026.02 | 37.3 | 40.9 | 40.9 | |
| DRAMA_HoulsbyArchitecture=BiEncoder, Framework=DRAMA, Adapter=Houlsby2026.02 | 37.3 | 40.8 | 40.9 | |
| MiniLM_ALLArchitecture=BiEncoder, Framework=Full Model, Specialization=General2026.02 | 37.1 | 40.7 | 40.6 | |
| DRAMA_LoRAArchitecture=BiEncoder, Framework=DRAMA, Adapter=LoRA2026.02 | 37.1 | 40.6 | 40.7 | |
| MiniLM_LoRAArchitecture=BiEncoder, Framework=Knowledge Distillation (Oracle), Adapter=LoRA2026.02 | 35.9 | 39.3 | 39.6 | |
| BM25Architecture=Sparse Retrieval2026.02 | 25 | 27.2 | 27.6 |