Target Generation on VAST Non-explicit (test)
0.9SemSim Score (SS)TSE-M
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TSE-MApproach=TG+SD2024.08 | 0.9 | 30.56 | 0.391 | |
| Llama-3-8BApproach=TG+SD2024.08 | 0.85 | 33.06 | 0.447 | |
| Llama-3-70BApproach=TG&SD2024.08 | 0.85 | 34.67 | 0.488 | |
| Mistral-largeApproach=TG+SD2024.08 | 0.85 | 35.38 | 0.465 | |
| GPT-3.5Approach=TG+SD2024.08 | 0.84 | 33.1 | 0.419 | |
| GPT-4oApproach=TG+SD2024.08 | 0.84 | 35.14 | 0.43 | |
| Gemini-flashApproach=TG+SD2024.08 | 0.84 | 34.59 | 0.347 | |
| Gemini-proApproach=TG&SD2024.08 | 0.84 | 34.85 | 0.453 | |
| Llama-3-70BApproach=TG+SD2024.08 | 0.84 | 32.98 | 0.48 | |
| GPT-3.5Approach=TG&SD2024.08 | 0.83 | 31.32 | 0.405 | |
| GPT-4oApproach=TG&SD2024.08 | 0.83 | 36.12 | 0.513 | |
| Gemini-flashApproach=TG&SD2024.08 | 0.83 | 34.73 | 0.365 | |
| Gemini-proApproach=TG+SD2024.08 | 0.83 | 33.44 | 0.365 | |
| Llama-3-8BApproach=TG&SD2024.08 | 0.83 | 33.81 | 0.49 | |
| Mistral-smallApproach=TG+SD2024.08 | 0.83 | 30.18 | 0.386 | |
| Mistral-smallApproach=TG&SD2024.08 | 0.83 | 34.12 | 0.495 | |
| Mistral-largeApproach=TG&SD2024.08 | 0.83 | 35.42 | 0.488 | |
| TSE-BApproach=TG+SD2024.08 | 0.82 | 29.32 | 0.215 |