Acronym Disambiguation on GLADIS
80.1Accuracy (General)LELA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LELAType=true zero-shot, backbone=Qwen3-30B-A3B2026.01 | 80.1 | 45.5 | 61.5 | 62.4 | |
| LELAType=true zero-shot, backbone=Magistral-Small-25092026.01 | 78.9 | 46.9 | 61 | 62.3 | |
| AcroBERTType=classical, variant=fine-tuned2026.01 | 76.1 | 27.6 | 69.2 | 57.7 | |
| LELAType=true zero-shot, backbone=Qwen3-4B2026.01 | 73.8 | 37.7 | 54.3 | 55.3 | |
| AcroBERTType=zero-shot2026.01 | 72 | 27.4 | 61.4 | 53.6 | |
| GENREType=true zero-shot, implementation=our implementation2026.01 | 63.9 | 3.9 | 7.1 | 25 | |
| Popularity baselineType=baseline2026.01 | 53.2 | 12.3 | 54 | 38.8 | |
| LELAType=true zero-shot, ablation=w/o LLM selection2026.01 | 44.2 | 22.7 | 22.6 | 29.8 | |
| BM25 baselineType=baseline2026.01 | 25.8 | 10.7 | 14.3 | 16.2 | |
| BLINKType=true zero-shot, implementation=our implementation2026.01 | 15.8 | 1.5 | 1.8 | 6.4 |