Aspect-conditioned Similarity on ASPECTSIM Sentence Level 1.0 (test)
0.576MPNet ScoreASPECTSIM
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| ASPECTSIMLLM Backbone=Qwen-2.5-32B2026.01 | 0.576 | 0.576 | 0.588 | 0.586 | 0.589 | 0.594 | 0.59 | 0.586 | 0.586 | 0.586 | |
| ASPECTSIMLLM Backbone=LLaMA-3.3-70B2026.01 | 0.575 | 0.576 | 0.591 | 0.585 | 0.591 | 0.596 | 0.592 | 0.591 | 0.588 | 0.587 | |
| ASPECTSIMLLM Backbone=Qwen-2.5-72B2026.01 | 0.573 | 0.572 | 0.591 | 0.586 | 0.587 | 0.591 | 0.59 | 0.588 | 0.588 | 0.585 | |
| ASPECTSIMLLM Backbone=Qwen-3-8B2026.01 | 0.571 | 0.567 | 0.583 | 0.577 | 0.581 | 0.584 | 0.582 | 0.58 | 0.577 | 0.578 | |
| ASPECTSIMLLM Backbone=Qwen-2.5-14B2026.01 | 0.566 | 0.566 | 0.579 | 0.578 | 0.577 | 0.582 | 0.579 | 0.577 | 0.576 | 0.576 | |
| ASPECTSIMLLM Backbone=Phi-4-14B2026.01 | 0.563 | 0.563 | 0.58 | 0.577 | 0.58 | 0.584 | 0.58 | 0.577 | 0.575 | 0.576 | |
| ASPECTSIMLLM Backbone=Qwen-2.5-72B2026.01 | 0.561 | 0.563 | 0.574 | 0.568 | 0.578 | 0.576 | 0.571 | 0.573 | 0.572 | 0.571 | |
| ASPECTSIMLLM Backbone=Qwen-3-4B2026.01 | 0.557 | 0.557 | 0.57 | 0.566 | 0.566 | 0.569 | 0.57 | 0.57 | 0.566 | 0.566 | |
| ASPECTSIMLLM Backbone=Phi-4-14B2026.01 | 0.557 | 0.556 | 0.569 | 0.565 | 0.577 | 0.576 | 0.567 | 0.572 | 0.565 | 0.567 | |
| ASPECTSIMLLM Backbone=DeepSeek-14B2026.01 | 0.556 | 0.552 | 0.569 | 0.568 | 0.571 | 0.574 | 0.569 | 0.567 | 0.567 | 0.566 | |
| ASPECTSIMLLM Backbone=DeepSeek-32B2026.01 | 0.553 | 0.554 | 0.571 | 0.566 | 0.569 | 0.572 | 0.573 | 0.566 | 0.567 | 0.566 | |
| ASPECTSIMLLM Backbone=Qwen-2.5-14B2026.01 | 0.551 | 0.548 | 0.562 | 0.557 | 0.571 | 0.568 | 0.564 | 0.562 | 0.56 | 0.56 | |
| ASPECTSIMLLM Backbone=Gemma-2-27B2026.01 | 0.549 | 0.549 | 0.574 | 0.566 | 0.568 | 0.573 | 0.572 | 0.571 | 0.567 | 0.566 | |
| ASPECTSIMLLM Backbone=Qwen-3-8B2026.01 | 0.548 | 0.546 | 0.557 | 0.552 | 0.561 | 0.56 | 0.557 | 0.558 | 0.555 | 0.555 | |
| ASPECTSIMLLM Backbone=Qwen-2.5-32B2026.01 | 0.547 | 0.546 | 0.562 | 0.553 | 0.571 | 0.567 | 0.558 | 0.565 | 0.559 | 0.559 | |
| ASPECTSIMLLM Backbone=DeepSeek-32B2026.01 | 0.546 | 0.543 | 0.556 | 0.551 | 0.562 | 0.559 | 0.557 | 0.555 | 0.554 | 0.554 | |
| ASPECTSIMLLM Backbone=Gemma-3-12B2026.01 | 0.531 | 0.534 | 0.555 | 0.547 | 0.555 | 0.561 | 0.556 | 0.554 | 0.552 | 0.549 | |
| ASPECTSIMLLM Backbone=LLaMA-3.3-70B2026.01 | 0.53 | 0.528 | 0.544 | 0.537 | 0.551 | 0.549 | 0.54 | 0.544 | 0.542 | 0.541 | |
| ASPECTSIMLLM Backbone=Qwen-3-4B2026.01 | 0.514 | 0.512 | 0.523 | 0.52 | 0.535 | 0.531 | 0.525 | 0.527 | 0.519 | 0.523 | |
| ASPECTSIMLLM Backbone=Gemma-3-12B2026.01 | 0.511 | 0.511 | 0.528 | 0.52 | 0.543 | 0.542 | 0.524 | 0.535 | 0.528 | 0.527 | |
| ASPECTSIMLLM Backbone=Mistral-7B2026.01 | 0.501 | 0.502 | 0.519 | 0.512 | 0.523 | 0.527 | 0.522 | 0.523 | 0.516 | 0.516 | |
| ASPECTSIMLLM Backbone=Gemma-2-27B2026.01 | 0.499 | 0.504 | 0.523 | 0.512 | 0.531 | 0.531 | 0.513 | 0.532 | 0.521 | 0.518 | |
| ASPECTSIMLLM Backbone=Phi-4-4B2026.01 | 0.475 | 0.476 | 0.487 | 0.482 | 0.483 | 0.484 | 0.485 | 0.484 | 0.483 | 0.482 | |
| ASPECTSIMLLM Backbone=DeepSeek-14B2026.01 | 0.467 | 0.467 | 0.48 | 0.475 | 0.487 | 0.485 | 0.48 | 0.482 | 0.479 | 0.478 | |
| ASPECTSIMLLM Backbone=Mistral-7B2026.01 | 0.455 | 0.454 | 0.471 | 0.463 | 0.488 | 0.483 | 0.467 | 0.476 | 0.466 | 0.469 | |
| ASPECTSIMLLM Backbone=LLaMA-3.2-3B2026.01 | 0.444 | 0.455 | 0.466 | 0.462 | 0.469 | 0.475 | 0.466 | 0.471 | 0.466 | 0.464 | |
| ASPECTSIMLLM Backbone=LLaMA-3.2-3B2026.01 | 0.388 | 0.39 | 0.402 | 0.396 | 0.406 | 0.404 | 0.397 | 0.395 | 0.395 | 0.397 | |
| ASPECTSIMLLM Backbone=Phi-4-4B2026.01 | 0.349 | 0.351 | 0.355 | 0.354 | 0.36 | 0.36 | 0.356 | 0.352 | 0.355 | 0.355 | |
| ASPECTSIMLLM Backbone=LLaMA-3.2-1B2026.01 | 0.097 | 0.109 | 0.107 | 0.105 | 0.111 | 0.109 | 0.104 | 0.118 | 0.111 | 0.107 | |
| ASPECTSIMLLM Backbone=Gemma-3-1B2026.01 | 0.092 | 0.095 | 0.113 | 0.107 | 0.109 | 0.107 | 0.105 | 0.108 | 0.102 | 0.104 | |
| ASPECTSIMLLM Backbone=Gemma-3-1B2026.01 | 0.068 | 0.055 | 0.061 | 0.056 | 0.071 | 0.069 | 0.045 | 0.051 | 0.045 | 0.058 | |
| ASPECTSIMLLM Backbone=LLaMA-3.2-1B2026.01 | 0.039 | 0.058 | 0.058 | 0.043 | 0.059 | 0.054 | 0.048 | 0.069 | 0.061 | 0.054 |