Target Generation on EZSTANCE Non-explicit (test)
0.85SS (SemSim)GPT-3.5
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT-3.5Approach=TG&SD2024.08 | 0.85 | 38.55 | 0.416 | |
| Llama-3-8BApproach=TG&SD2024.08 | 0.84 | 39.91 | 0.383 | |
| Llama-3-70BApproach=TG&SD2024.08 | 0.84 | 42.02 | 0.451 | |
| Mistral-largeApproach=TG&SD2024.08 | 0.84 | 39.98 | 0.424 | |
| GPT-4oApproach=TG&SD2024.08 | 0.83 | 39.84 | 0.45 | |
| Gemini-flashApproach=TG&SD2024.08 | 0.83 | 39.27 | 0.394 | |
| Llama-3-70BApproach=TG+SD2024.08 | 0.83 | 40.47 | 0.447 | |
| Gemini-proApproach=TG&SD2024.08 | 0.82 | 40.53 | 0.482 | |
| Llama-3-8BApproach=TG+SD2024.08 | 0.82 | 38.74 | 0.33 | |
| Mistral-largeApproach=TG+SD2024.08 | 0.82 | 39.32 | 0.394 | |
| Gemini-flashApproach=TG+SD2024.08 | 0.81 | 39.22 | 0.306 | |
| Mistral-smallApproach=TG&SD2024.08 | 0.81 | 40.05 | 0.447 | |
| GPT-4oApproach=TG+SD2024.08 | 0.8 | 38.55 | 0.387 | |
| Gemini-proApproach=TG+SD2024.08 | 0.8 | 39.9 | 0.447 | |
| Mistral-smallApproach=TG+SD2024.08 | 0.8 | 39.75 | 0.405 | |
| GPT-3.5Approach=TG+SD2024.08 | 0.79 | 38.1 | 0.31 |