Temporal Reasoning on BIG-bench Hard Temporal Sequences (test)
62Test AccuracyPE2
Evaluation Results
| Method | Links | |
|---|---|---|
| PE2Final Prompt=Let's analyze the timeline and others' observations to deduce the only time slots not accounted for, indicating when the visit could have occurred., Task Model=Mistral-7B-Instruct-v0.2, Prompt Proposal Model=gpt-4-turbo2023.11 | 62 | |
| APOFinal Prompt=Identify when a person visited a place by excluding times they were seen elsewhere, considering their schedule, eyewitness sightings, and the place's hours. Only include unaccounted times., Task Model=Mistral-7B-Instruct-v0.2, Prompt Proposal Model=gpt-4-turbo2023.11 | 52 | |
| Zero-shot CoTFinal Prompt=Let's think step by step., Task Model=Mistral-7B-Instruct-v0.2, Prompt Proposal Model=gpt-4-turbo2023.11 | 50 | |
| Iterative APEFinal Prompt=Let's progress by breaking it down into smaller, manageable parts., Task Model=Mistral-7B-Instruct-v0.2, Prompt Proposal Model=gpt-4-turbo2023.11 | 42 |