List your company
ResearchFormerly WizWand

Logical Reasoning on T-Obj.

62AccuracyIAP-mv
-2.396814.321631.0447.7584Sep 30, 2024
Updated 8mo ago

Evaluation results

MethodLinks
IAP-mvBackbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0962
Prompt #4Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0960.4
Prompt #2Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0930
Prompt #7Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0924
Prompt #3Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0923.2
Prompt #9Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0920.4
Prompt #8Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0918.4
Prompt #6Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0916
Prompt #1Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0912.4
IAP-mvBackbone=LLaMA-2-13B-Chat2024.099.6
Prompt #6Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.099.2
IAP-ssBackbone=LLaMA-2-13B-Chat2024.098.8
Prompt #2Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.098
Prompt #5Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.096.8
Prompt #1Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.095.6
Prompt #3Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.094.8
Prompt #8Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.093.2
Prompt #7Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.092.8
Self-discBackbone=LLaMA-2-13B-Chat2024.092.4
Prompt #4Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.091.6
Prompt #9Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.091.6
Prompt #5Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.090.8
OPPRBackbone=LLaMA-2-13B-Chat2024.090.08