Target Generation on VAST Explicit (test)
0.96SS (SemSim)TSE-M
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TSE-MApproach=TG+SD2024.08 | 0.96 | 36.63 | 0.716 | |
| Gemini-proApproach=TG&SD2024.08 | 0.89 | 40.92 | 0.664 | |
| GPT-4oApproach=TG&SD2024.08 | 0.88 | 41.92 | 0.69 | |
| Gemini-flashApproach=TG&SD2024.08 | 0.88 | 40.87 | 0.624 | |
| Llama-3-8BApproach=TG+SD2024.08 | 0.88 | 38.31 | 0.54 | |
| Llama-3-70BApproach=TG+SD2024.08 | 0.88 | 41.01 | 0.57 | |
| Llama-3-70BApproach=TG&SD2024.08 | 0.88 | 41.52 | 0.635 | |
| Mistral-largeApproach=TG+SD2024.08 | 0.88 | 39.32 | 0.543 | |
| Mistral-largeApproach=TG&SD2024.08 | 0.88 | 41.39 | 0.647 | |
| GPT-3.5Approach=TG+SD2024.08 | 0.87 | 38.43 | 0.546 | |
| GPT-3.5Approach=TG&SD2024.08 | 0.87 | 39.6 | 0.663 | |
| GPT-4oApproach=TG+SD2024.08 | 0.87 | 41.55 | 0.566 | |
| Gemini-flashApproach=TG+SD2024.08 | 0.87 | 40.02 | 0.593 | |
| Llama-3-8BApproach=TG&SD2024.08 | 0.87 | 37.75 | 0.558 | |
| Mistral-smallApproach=TG&SD2024.08 | 0.87 | 39.02 | 0.65 | |
| TSE-BApproach=TG+SD2024.08 | 0.86 | 35.8 | 0.338 | |
| Gemini-proApproach=TG+SD2024.08 | 0.86 | 40.81 | 0.643 | |
| Mistral-smallApproach=TG+SD2024.08 | 0.85 | 38.47 | 0.586 |