Information Retrieval on Academic Search Physics
0.207MAP@100BERT-T
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BERT-TTraining Paradigm=Full Model, Model Architecture=BERT2026.02 | 0.207 | 0.657 | 0.364 | |
| DistilBERT-STraining Paradigm=Full Model, Model Architecture=DistilBERT2026.02 | 0.2 | 0.65 | 0.356 | |
| DistilBERT-HoulsbyTraining Paradigm=Knowledge Distillation (Oracle), Model Architecture=DistilBERT, Adapter Type=Houlsby2026.02 | 0.196 | 0.646 | 0.351 | |
| DistilBERT-HoulsbyTraining Paradigm=DRAMA, Model Architecture=DistilBERT, Adapter Type=Houlsby2026.02 | 0.196 | 0.647 | 0.352 | |
| DistilBERT-ALLTraining Paradigm=Full Model, Model Architecture=DistilBERT2026.02 | 0.19 | 0.637 | 0.345 | |
| DistilBERT-LoRATraining Paradigm=Knowledge Distillation (Oracle), Model Architecture=DistilBERT, Adapter Type=LoRA2026.02 | 0.19 | 0.638 | 0.345 | |
| DistilBERT-LoRATraining Paradigm=DRAMA, Model Architecture=DistilBERT, Adapter Type=LoRA2026.02 | 0.19 | 0.637 | 0.345 | |
| MiniLM_SBackbone=MiniLM, Training Paradigm=Full Model, Training Scope=S2026.02 | 0.182 | 0.626 | 0.335 | |
| MiniLM_HoulsbyBackbone=MiniLM, Training Paradigm=Knowledge Distillation (Oracle), Adapter Type=Houlsby2026.02 | 0.182 | 0.626 | 0.335 | |
| MiniLM_HoulsbyBackbone=MiniLM, Training Paradigm=DRAMA, Adapter Type=Houlsby2026.02 | 0.182 | 0.627 | 0.335 | |
| MiniLM_LoRABackbone=MiniLM, Training Paradigm=Knowledge Distillation (Oracle), Adapter Type=LoRA2026.02 | 0.181 | 0.624 | 0.332 | |
| MiniLM_LoRABackbone=MiniLM, Training Paradigm=DRAMA, Adapter Type=LoRA2026.02 | 0.181 | 0.624 | 0.332 | |
| MiniLM_ALLBackbone=MiniLM, Training Paradigm=Full Model, Training Scope=ALL2026.02 | 0.178 | 0.62 | 0.33 | |
| MiniLM_SArchitecture=CrossEncoder, Training Paradigm=Full Model, Model Variant=Specialized2026.02 | 0.174 | 0.624 | 0.328 | |
| MiniLM_HoulsbyArchitecture=CrossEncoder, Training Paradigm=Knowledge Distillation (Oracle), Adapter Type=Houlsby2026.02 | 0.172 | 0.62 | 0.322 | |
| DRAMA (MiniLM_Houlsby)Architecture=CrossEncoder, Training Paradigm=DRAMA, Adapter Type=Houlsby2026.02 | 0.171 | 0.618 | 0.32 | |
| MiniLM_LoRAArchitecture=CrossEncoder, Training Paradigm=Knowledge Distillation (Oracle), Adapter Type=LoRA2026.02 | 0.159 | 0.605 | 0.311 | |
| DRAMA (MiniLM_LoRA)Architecture=CrossEncoder, Training Paradigm=DRAMA, Adapter Type=LoRA2026.02 | 0.158 | 0.604 | 0.311 | |
| MiniLM_ALLArchitecture=CrossEncoder, Training Paradigm=Full Model, Model Variant=General2026.02 | 0.155 | 0.6 | 0.307 | |
| BM252026.02 | 0.128 | 0.537 | 0.269 | |
| BM25Type=Unsupervised Baseline2026.02 | 0.128 | 0.537 | 0.269 | |
| BM25Training Paradigm=Lexical Baseline2026.02 | 0.128 | 0.537 | 0.269 |