Logic reasoning on Causal Judgement
36AccuracySelf-discover
Evaluation Results
| Method | Links | |
|---|---|---|
| Self-discoverBackbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 36 | |
| IAP-mvBackbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 29.95 | |
| Prompt #5Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 28.34 | |
| AMV (#1-7)Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 27.5 | |
| IAP-ssBackbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 26.74 | |
| AMV (all)Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 26.1 | |
| OPPRBackbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 19.79 | |
| IAP-mvBackbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 19.25 | |
| OPPRBackbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 18.18 | |
| AMV (#1-7)Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 18.13 | |
| Prompt #2Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 17.11 | |
| AMV (all)Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 17.06 | |
| IAP-ssBackbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 16.57 | |
| Prompt #8Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 16.04 | |
| Prompt #2Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 14.97 | |
| Prompt #4Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 13.9 | |
| Prompt #3Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 12.3 | |
| Self-discoverBackbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 11.23 | |
| Prompt #3Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 9.63 | |
| Prompt #1Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 9.09 | |
| Prompt #4Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 6.95 | |
| Prompt #5Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 5.35 | |
| Prompt #1Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 4.28 | |
| Prompt #6Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 3.74 | |
| Prompt #6Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 3.21 | |
| Prompt #9Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 2.67 | |
| Prompt #7Backbone=LLaMA-3-8B-Instruct, Zero-shot CoT=true2024.09 | 2.14 | |
| Prompt #9Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 2.14 | |
| Prompt #7Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 1.07 | |
| Prompt #8Backbone=Qwen-14B-Chat, Zero-shot CoT=true2024.09 | 1.07 |