Semantic Similarity on ICEWS18 (test)
40.39BLEU-4Llama3-8B-Instruct
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Llama3-8B-InstructType=GETER2025.05 | 40.39 | 52.12 | 54.85 | 84.6 | |
| Mistral-7B-InstructType=GETER2025.05 | 39.64 | 51.62 | 54.04 | 84.37 | |
| Qwen2.5-7B-InstructType=GETER2025.05 | 38.99 | 50.7 | 53.79 | 84.17 | |
| Qwen2.5-7B-InstructType=LoRA2025.05 | 37.49 | 49.61 | 52.07 | 83.6 | |
| Llama3-8B-InstructType=LoRA2025.05 | 37.33 | 49.18 | 53.05 | 83.58 | |
| Mistral-7B-InstructType=LoRA2025.05 | 36.96 | 49.12 | 51.7 | 83.38 | |
| Qwen2.5-7B-InstructType=LoRA w/o chains text2025.05 | 25.5 | 37.61 | 42.91 | 78.56 | |
| Mistral-7B-InstructType=LoRA w/o chains text2025.05 | 25.46 | 37.62 | 42.91 | 78.67 | |
| Llama3-8B-InstructType=LoRA w/o chains text2025.05 | 23.55 | 35.95 | 42.54 | 78.02 | |
| GPT-4oType=zero-shot2025.05 | 14.84 | 31.16 | 37.47 | 72.98 | |
| Qwen2.5-7B-InstructType=zero-shot2025.05 | 10.46 | 27.97 | 26.8 | 71.77 | |
| Llama3-8B-InstructType=zero-shot2025.05 | 10.01 | 29.52 | 27.19 | 70.01 | |
| Mistral-7B-InstructType=zero-shot2025.05 | 9.74 | 29 | 26 | 71.95 | |
| GPT-4oType=zero-shot w/o chains text2025.05 | 9.33 | 22.67 | 29.87 | 67.48 | |
| Mistral-7B-InstructType=zero-shot w/o chains text2025.05 | 7.6 | 19.43 | 23.98 | 65.87 | |
| Qwen2.5-7B-InstructType=zero-shot w/o chains text2025.05 | 7.02 | 19.52 | 30.09 | 65.92 | |
| Llama3-8B-InstructType=zero-shot w/o chains text2025.05 | 4.1 | 15.85 | 16.2 | 61.14 |