Semantic Similarity Identification on SMP (test)
97.18F1 ScoreAgentReuse
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| AgentReusesimilarity threshold (γ)=0.75, parameter_extraction=true2025.12 | 97.18 | 99.31 | 95.13 | 94.59 | |
| OneIntentsimilarity threshold (γ)=0.75, variant=Searches all cached content2025.12 | 97.12 | 98.57 | 95.71 | 94.44 | |
| GPTCachesimilarity threshold (γ)=0.752025.12 | 91 | 98.87 | 84.28 | 83.66 | |
| WithArgssimilarity threshold (γ)=0.75, parameter_extraction=false2025.12 | 90.35 | 99.67 | 82.62 | 82.72 | |
| MeanCachesimilarity threshold (γ)=0.752025.12 | 62.11 | 99.91 | 45.06 | 46.14 |