Response Similarity on Craigslist
91.9Response SimilaritySOMA
Evaluation results
| Method | Links | |
|---|---|---|
| SOMAModel Family=LLaMA2026.05 | 91.9 | |
| RouteLLMModel Family=LLaMA2026.05 | 91 | |
| History-FTModel Family=LLaMA2026.05 | 90.3 | |
| History-PrefixModel Family=LLaMA2026.05 | 82.4 | |
| LLMLingua-2Model Family=LLaMA2026.05 | 80.8 | |
| SOMAOriginal Model=Qwen-3-8B, Surrogate Model=Qwen-3-0.6B2026.05 | 76.4 | |
| RouteLLMOriginal Model=Qwen-3-8B, Surrogate Model=Qwen-3-0.6B2026.05 | 75.1 | |
| History-FTOriginal Model=Qwen-3-8B, Surrogate Model=Qwen-3-0.6B2026.05 | 74.5 | |
| SurrogateModel Family=LLaMA2026.05 | 74.3 | |
| History-PrefixOriginal Model=Qwen-3-8B, Surrogate Model=Qwen-3-0.6B2026.05 | 63 | |
| LLMLingua-2Original Model=Qwen-3-8B, Surrogate Model=Qwen-3-0.6B2026.05 | 61.2 | |
| SurrogateOriginal Model=Qwen-3-8B, Surrogate Model=Qwen-3-0.6B2026.05 | 48.2 |