List your company
ResearchFormerly WizWand

Logical Reasoning on C-Judge

56.2AccuracyIAP-mv
5.541618.693331.84544.9967Sep 30, 2024
Updated 8mo ago

Evaluation results

MethodLinks
IAP-mvBackbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0956.2
Prompt #8Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0955.61
Prompt #2Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0954.55
Prompt #3Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0949.73
Prompt #7Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0947.59
Prompt #9Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0944.92
Prompt #6Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0944.39
Prompt #4Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0942.25
Prompt #1Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0938.5
Prompt #5Backbone=LLaMA-3 70B, Setting=Zero-shot CoT2024.0936.36
IAP-mvBackbone=LLaMA-2-13B-Chat2024.0933.47
Prompt #6Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0932.68
IAP-ssBackbone=LLaMA-2-13B-Chat2024.0932.56
Prompt #3Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0924.06
Prompt #4Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0916.58
Prompt #5Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0914.97
Prompt #7Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0914.97
Prompt #2Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0913.9
OPPRBackbone=LLaMA-2-13B-Chat2024.0913.37
Prompt #1Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0911.76
Self-discBackbone=LLaMA-2-13B-Chat2024.0910.16
Prompt #9Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.099.62
Prompt #8Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.097.49