List your company

Symbolic Reasoning on Date Understanding (DU) (test)

67.52AccuracySoftCoT
66.355266.657666.9667.2624Feb 17, 2025

Evaluation results

MethodLinks
SoftCoTBackbone=Qwen2.5-7B-Instruct, Training Objective=Language Modeling Objective, Evaluation Protocol=Projection Module Trained2025.0267.5275.06
Zero-Shot Assist-CoTBackbone=Qwen2.5-7B-Instruct, Training Objective=None, Evaluation Protocol=Zero-Shot2025.0267.0471.64
Zero-Shot CoT-UnkBackbone=Qwen2.5-7B-Instruct, Training Objective=None, Evaluation Protocol=Zero-Shot2025.0266.4870.6
Zero-Shot CoTBackbone=Qwen2.5-7B-Instruct, Training Objective=None, Evaluation Protocol=Zero-Shot2025.0266.470.29