Semantic Textual Similarity on Big Patent (BP)
27.38STS ScorePrompt-Tuning
Evaluation Results
| Method | Links | |
|---|---|---|
| Prompt-TuningBackbone=Qwen2.5-7B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 27.38 | |
| PromptEmbedderBackbone=LLaMA-3.2-3B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 26.92 | |
| LoRABackbone=LLaMA-3.2-3B, Evaluation Protocol=Fine-tuning2026.05 | 26.91 | |
| Prompt-TuningBackbone=LLaMA-3.2-3B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 26.47 | |
| PromptEOLBackbone=Qwen2.5-7B, Evaluation Protocol=Training-free Prompting2026.05 | 26.23 | |
| LoRABackbone=Qwen2.5-7B, Evaluation Protocol=Fine-tuning2026.05 | 26.15 | |
| PromptEmbedderBackbone=Qwen2.5-7B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 25.9 | |
| Pretend-CoTBackbone=Qwen2.5-7B, Evaluation Protocol=Training-free Prompting2026.05 | 25.67 | |
| PromptEmbedderBackbone=LLaMA-3.2-1B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 24.85 | |
| LoRABackbone=LLaMA-3.2-1B, Evaluation Protocol=Fine-tuning2026.05 | 24.85 | |
| Prompt-TuningBackbone=Mistral-7B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 23.91 | |
| PromptEOLBackbone=LLaMA-3.2-1B, Evaluation Protocol=Training-free Prompting2026.05 | 23.65 | |
| PromptEOLBackbone=LLaMA-3.2-3B, Evaluation Protocol=Training-free Prompting2026.05 | 23.48 | |
| EchoBackbone=LLaMA-3.2-3B, Evaluation Protocol=Training-free Prompting2026.05 | 22.38 | |
| Pretend-CoTBackbone=LLaMA-3.2-1B, Evaluation Protocol=Training-free Prompting2026.05 | 22.27 | |
| EchoBackbone=Qwen2.5-7B, Evaluation Protocol=Training-free Prompting2026.05 | 21.74 | |
| PromptEOLBackbone=Mistral-7B, Evaluation Protocol=Training-free Prompting2026.05 | 21.7 | |
| Pretend-CoTBackbone=LLaMA-3.2-3B, Evaluation Protocol=Training-free Prompting2026.05 | 21.25 | |
| Pretend-CoTBackbone=Mistral-7B, Evaluation Protocol=Training-free Prompting2026.05 | 21.17 | |
| EchoBackbone=LLaMA-3.2-1B, Evaluation Protocol=Training-free Prompting2026.05 | 20.74 | |
| Prompt-TuningBackbone=LLaMA-3.2-1B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 20.21 | |
| EchoBackbone=Mistral-7B, Evaluation Protocol=Training-free Prompting2026.05 | 19.79 | |
| LoRABackbone=Mistral-7B, Evaluation Protocol=Fine-tuning2026.05 | 18.83 | |
| PromptEmbedderBackbone=Mistral-7B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 18.6 |