Cause to Effect Ranking on e-CARE + RedPajama XL
30.3Hit Rate @ 1Cawai-BGE M3
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Cawai-BGE M32025.04 | 30.3 | 45.3 | 34.8 | |
| Cawai-BGE M32025.04 | 28.9 | 45.4 | 33.7 | |
| Cawai-DPR2025.04 | 20.9 | 34 | 24.8 | |
| Cawai-GTR2025.04 | 20.1 | 36.3 | 24.7 | |
| Cawai-GTR2025.04 | 19.6 | 34.6 | 24.1 | |
| BGE M32025.04 | 19 | 35.3 | 23.7 | |
| GTR2025.04 | 18.3 | 36 | 23.5 | |
| Cawai-DPR2025.04 | 18.1 | 29.4 | 21.3 | |
| GTR2025.04 | 18.1 | 35.6 | 23 | |
| BGE M32025.04 | 17.7 | 34.1 | 22.6 | |
| DPR2025.04 | 14.4 | 28.8 | 18.6 | |
| DPR2025.04 | 13.7 | 25.8 | 17.3 | |
| BM252025.04 | 4.9 | 9.3 | 6.1 | |
| BM252025.04 | 4.6 | 9.2 | 5.9 | |
| Cawai-LLaMA 1B (Lora)Model size=1B, Tuning=LoRA2025.04 | 4.6 | 12.4 | 6.7 | |
| Cawai-LLaMA 1B (Lora)Model size=1B, Tuning=LoRA2025.04 | 3.6 | 9.5 | 5.1 | |
| LLaMA 1B (Lora)Model size=1B, Tuning=LoRA2025.04 | 3 | 8.9 | 4.8 | |
| LLaMA 1B (Lora)Model size=1B, Tuning=LoRA2025.04 | 1.9 | 5.8 | 2.9 |