Aspect-conditioned Similarity on ASPECTSIM Span Level 1.0 (test)
0.574MPNet ScoreASPECTSIM
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| ASPECTSIMLLM Backbone=Qwen-2.5-72B2026.01 | 0.574 | 0.578 | 0.588 | 0.579 | 0.583 | 0.584 | 0.584 | 0.59 | 0.585 | 0.583 | |
| ASPECTSIMLLM Backbone=LLaMA-3.3-70B2026.01 | 0.569 | 0.573 | 0.586 | 0.577 | 0.578 | 0.579 | 0.581 | 0.586 | 0.584 | 0.579 | |
| ASPECTSIMLLM Backbone=Phi-4-14B2026.01 | 0.568 | 0.571 | 0.581 | 0.573 | 0.574 | 0.576 | 0.576 | 0.581 | 0.578 | 0.575 | |
| ASPECTSIMLLM Backbone=Qwen-2.5-14B2026.01 | 0.567 | 0.57 | 0.58 | 0.575 | 0.575 | 0.577 | 0.578 | 0.581 | 0.578 | 0.576 | |
| ASPECTSIMLLM Backbone=Qwen-2.5-32B2026.01 | 0.565 | 0.57 | 0.582 | 0.572 | 0.573 | 0.574 | 0.574 | 0.579 | 0.576 | 0.574 | |
| ASPECTSIMLLM Backbone=Gemma-2-27B2026.01 | 0.564 | 0.566 | 0.581 | 0.572 | 0.571 | 0.573 | 0.573 | 0.58 | 0.579 | 0.573 | |
| ASPECTSIMLLM Backbone=Qwen-3-8B2026.01 | 0.564 | 0.562 | 0.575 | 0.569 | 0.564 | 0.566 | 0.567 | 0.572 | 0.569 | 0.578 | |
| ASPECTSIMLLM Backbone=DeepSeek-14B2026.01 | 0.561 | 0.56 | 0.575 | 0.564 | 0.565 | 0.566 | 0.568 | 0.569 | 0.568 | 0.565 | |
| ASPECTSIMLLM Backbone=Qwen-3-4B2026.01 | 0.56 | 0.561 | 0.57 | 0.564 | 0.563 | 0.564 | 0.564 | 0.571 | 0.565 | 0.566 | |
| ASPECTSIMLLM Backbone=DeepSeek-32B2026.01 | 0.551 | 0.552 | 0.568 | 0.56 | 0.562 | 0.564 | 0.566 | 0.566 | 0.563 | 0.566 | |
| ASPECTSIMLLM Backbone=Gemma-3-12B2026.01 | 0.542 | 0.544 | 0.561 | 0.548 | 0.55 | 0.55 | 0.557 | 0.56 | 0.554 | 0.552 | |
| ASPECTSIMLLM Backbone=Mistral-7B2026.01 | 0.517 | 0.515 | 0.535 | 0.526 | 0.528 | 0.528 | 0.529 | 0.53 | 0.533 | 0.527 | |
| ASPECTSIMLLM Backbone=Phi-4-4B2026.01 | 0.496 | 0.495 | 0.504 | 0.504 | 0.497 | 0.498 | 0.503 | 0.497 | 0.501 | 0.5 | |
| ASPECTSIMLLM Backbone=LLaMA-3.2-3B2026.01 | 0.444 | 0.447 | 0.46 | 0.478 | 0.465 | 0.466 | 0.466 | 0.471 | 0.472 | 0.466 | |
| ASPECTSIMLLM Backbone=LLaMA-3.2-1B2026.01 | 0.087 | 0.096 | 0.102 | 0.103 | 0.102 | 0.104 | 0.095 | 0.107 | 0.102 | 0.1 | |
| ASPECTSIMLLM Backbone=Gemma-3-1B2026.01 | 0.014 | 0.145 | 0.153 | 0.142 | 0.154 | 0.153 | 0.152 | 0.137 | 0.146 | 0.146 |