Entailment on Compositional Entailment Conjunction
96.55ROC AUCmpnet-base-v2 + SPH (SE128)
Evaluation Results
| Method | Links | |
|---|---|---|
| mpnet-base-v2 + SPH (SE128)Backbone=mpnet-base-v2, Head=SPH, Representation Dimension=128, Zero-shot protocol=true2025.08 | 96.55 | |
| mpnet-base-v2 + SPH (SE64)Backbone=mpnet-base-v2, Head=SPH, Representation Dimension=64, Zero-shot protocol=true2025.08 | 95.87 | |
| all-MiniLM-L6-v2 + SPH (SE128)Backbone=all-MiniLM-L6-v2, Head=SPH, Representation Dimension=128, Zero-shot protocol=true2025.08 | 95.02 | |
| all-MiniLM-L6-v2 + SPH (SE64)Backbone=all-MiniLM-L6-v2, Head=SPH, Representation Dimension=64, Zero-shot protocol=true2025.08 | 94.68 | |
| mpnet-base-v2 + Box64Backbone=mpnet-base-v2, Head=Box, Representation Dimension=64, Zero-shot protocol=true2025.08 | 91.51 | |
| all-MiniLM-L6-v2 + MLP(p, h, p - h)Backbone=all-MiniLM-L6-v2, Head=MLP(p, h, p - h), Zero-shot protocol=true2025.08 | 91.22 | |
| mpnet-base-v2 + MLP(p, h, p - h)Backbone=mpnet-base-v2, Head=MLP(p, h, p - h), Zero-shot protocol=true2025.08 | 90.2 | |
| mpnet-base-v2 + Box128Backbone=mpnet-base-v2, Head=Box, Representation Dimension=128, Zero-shot protocol=true2025.08 | 89.95 | |
| all-MiniLM-L6-v2 + MLP(p, h)Backbone=all-MiniLM-L6-v2, Head=MLP(p, h), Zero-shot protocol=true2025.08 | 86.45 | |
| mpnet-base-v2 + MLP(p, h)Backbone=mpnet-base-v2, Head=MLP(p, h), Zero-shot protocol=true2025.08 | 82.91 |