List your company
ResearchFormerly WizWand

Logical Deduction (Seven Objects) on BBH (test)

55.2AccuracyTextReg
38.0442.49546.9551.405Jun 21, 2023Dec 15, 2023Jun 9, 2024Dec 4, 2024May 30, 2025Nov 23, 2025May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TextRegTest Engine=Phi-3.5-Mini-Instruct2026.0555.2
TextRegTest Engine=Llama-3-8B-Instruct2026.0552
TextRegTest Engine=Llama-3.1-8B-Instruct2026.0551
REVOLVETest Engine=Llama-3.1-8B-Instruct2026.0550.6
CoTTest Engine=Phi-3.5-Mini-Instruct2026.0550.5
CoTTest Engine=Llama-3.1-8B-Instruct2026.0550.4
TextGradTest Engine=Llama-3.1-8B-Instruct2026.0550.4
CoTTest Engine=Llama-3-8B-Instruct2026.0548.8
REVOLVETest Engine=Llama-3-8B-Instruct2026.0548.8
TextRegTest Engine=Qwen2-7B-Instruct2026.0547.8
REVOLVETest Engine=Qwen2-7B-Instruct2026.0547.6
DLN-1LLM=GPT-32023.0647.5
CoTTest Engine=Qwen2-7B-Instruct2026.0547.4
TextGradTest Engine=Qwen2-7B-Instruct2026.0546.6
TextGradTest Engine=Phi-3.5-Mini-Instruct2026.0546.4
0-shotLLM=GPT-32023.0645.9
DLN-2LLM=GPT-32023.0645.7
APE-400LLM=GPT-32023.0645.6
APELLM=GPT-32023.0645.5
CoTLLM=GPT-32023.0641.1
TextGradTest Engine=Llama-3-8B-Instruct2026.0541.1
REVOLVETest Engine=Phi-3.5-Mini-Instruct2026.0538.7