Logical Reasoning on T-Obj.
62AccuracyIAP-mv
Evaluation Results
| Method | Links | |
|---|---|---|
| IAP-mvBackbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.09 | 62 | |
| Prompt #4Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.09 | 60.4 | |
| Prompt #2Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.09 | 30 | |
| Prompt #7Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.09 | 24 | |
| Prompt #3Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.09 | 23.2 | |
| Prompt #9Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.09 | 20.4 | |
| Prompt #8Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.09 | 18.4 | |
| Prompt #6Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.09 | 16 | |
| Prompt #1Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.09 | 12.4 | |
| IAP-mvBackbone=LLaMA-2-13B-Chat2024.09 | 9.6 | |
| Prompt #6Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.09 | 9.2 | |
| IAP-ssBackbone=LLaMA-2-13B-Chat2024.09 | 8.8 | |
| Prompt #2Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.09 | 8 | |
| Prompt #5Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.09 | 6.8 | |
| Prompt #1Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.09 | 5.6 | |
| Prompt #3Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.09 | 4.8 | |
| Prompt #8Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.09 | 3.2 | |
| Prompt #7Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.09 | 2.8 | |
| Self-discBackbone=LLaMA-2-13B-Chat2024.09 | 2.4 | |
| Prompt #4Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.09 | 1.6 | |
| Prompt #9Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.09 | 1.6 | |
| Prompt #5Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.09 | 0.8 | |
| OPPRBackbone=LLaMA-2-13B-Chat2024.09 | 0.08 |