Semantic Textual Similarity on PaperCode (PC)
44.26STSLoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| LoRABackbone=Mistral-7B, Evaluation Protocol=Fine-tuning2026.05 | 44.26 | |
| LoRABackbone=LLaMA-3.2-3B, Evaluation Protocol=Fine-tuning2026.05 | 42.56 | |
| LoRABackbone=Qwen2.5-7B, Evaluation Protocol=Fine-tuning2026.05 | 39.52 | |
| Prompt-TuningBackbone=LLaMA-3.2-3B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 39.5 | |
| Prompt-TuningBackbone=Mistral-7B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 39.32 | |
| PromptEmbedderBackbone=Qwen2.5-7B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 38.44 | |
| EchoBackbone=LLaMA-3.2-3B, Evaluation Protocol=Training-free Prompting2026.05 | 36.37 | |
| Prompt-TuningBackbone=Qwen2.5-7B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 33.97 | |
| EchoBackbone=LLaMA-3.2-1B, Evaluation Protocol=Training-free Prompting2026.05 | 33.13 | |
| LoRABackbone=LLaMA-3.2-1B, Evaluation Protocol=Fine-tuning2026.05 | 30.61 | |
| Pretend-CoTBackbone=Mistral-7B, Evaluation Protocol=Training-free Prompting2026.05 | 30.31 | |
| Prompt-TuningBackbone=LLaMA-3.2-1B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 29.23 | |
| PromptEOLBackbone=Qwen2.5-7B, Evaluation Protocol=Training-free Prompting2026.05 | 28.92 | |
| Pretend-CoTBackbone=Qwen2.5-7B, Evaluation Protocol=Training-free Prompting2026.05 | 28.47 | |
| EchoBackbone=Mistral-7B, Evaluation Protocol=Training-free Prompting2026.05 | 28.41 | |
| PromptEmbedderBackbone=LLaMA-3.2-3B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 28.16 | |
| PromptEmbedderBackbone=LLaMA-3.2-1B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 27.74 | |
| Pretend-CoTBackbone=LLaMA-3.2-3B, Evaluation Protocol=Training-free Prompting2026.05 | 26.82 | |
| PromptEOLBackbone=Mistral-7B, Evaluation Protocol=Training-free Prompting2026.05 | 26.14 | |
| EchoBackbone=Qwen2.5-7B, Evaluation Protocol=Training-free Prompting2026.05 | 26.1 | |
| PromptEOLBackbone=LLaMA-3.2-1B, Evaluation Protocol=Training-free Prompting2026.05 | 24.61 | |
| PromptEOLBackbone=LLaMA-3.2-3B, Evaluation Protocol=Training-free Prompting2026.05 | 24.37 | |
| PromptEmbedderBackbone=Mistral-7B, Evaluation Protocol=Frozen Backbone Methods2026.05 | 21.72 | |
| Pretend-CoTBackbone=LLaMA-3.2-1B, Evaluation Protocol=Training-free Prompting2026.05 | 21.41 |