List your company
ResearchFormerly WizWand

Sentencing Prediction on CAIL Law Domain

85AccuracyRe-TASK (Lite)
31.4445.34559.2573.155Aug 13, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Re-TASK (Lite)Backbone=Yi-1.5-9B, Prompting Strategy=Re-TASK (Lite)2024.088527.17
Re-TASK (Lite)Backbone=Llama3-Chinese-8B, Prompting Strategy=Re-TASK (Lite)2024.0878.527.17
Step-BackBackbone=Llama3-Chinese-8B, Prompting Strategy=Step-Back2024.0872.518
Step-BackBackbone=Yi-1.5-9B, Prompting Strategy=Step-Back2024.0872.518
Three-shot CoTBackbone=Yi-1.5-9B, Prompting Strategy=Three-shot CoT2024.0870.1712.5
One-shot CoTBackbone=Yi-1.5-9B, Prompting Strategy=One-shot CoT2024.0866.59.61
Re-TASK (+K0)Backbone=Llama3-Chinese-8B, Prompting Strategy=Re-TASK (+K0)2024.0860.511.5
Re-TASK (+K0)Backbone=Yi-1.5-9B, Prompting Strategy=Re-TASK (+K0)2024.0857.511.5
Three-shot CoTBackbone=Llama3-Chinese-8B, Prompting Strategy=Three-shot CoT2024.0856.3312.5
Zero-shot CoT + SCBackbone=Llama3-Chinese-8B, Prompting Strategy=Zero-shot CoT + SC2024.0854.50.33
Plan-and-SolveBackbone=Llama3-Chinese-8B, Prompting Strategy=Plan-and-Solve2024.0854.51.83
Zero-shot CoTBackbone=Llama3-Chinese-8B, Prompting Strategy=Zero-shot CoT2024.0854—
One-shot CoTBackbone=Llama3-Chinese-8B, Prompting Strategy=One-shot CoT2024.0853.679.61
Re-TASK (Lite)Backbone=Qwen1.5-7B, Prompting Strategy=Re-TASK (Lite)2024.0845.527.17
Plan-and-SolveBackbone=Qwen1.5-7B, Prompting Strategy=Plan-and-Solve2024.08451.83
Re-TASK (+K0)Backbone=Qwen1.5-7B, Prompting Strategy=Re-TASK (+K0)2024.084411.5
Zero-shot CoT + SCBackbone=Yi-1.5-9B, Prompting Strategy=Zero-shot CoT + SC2024.0840.50.33
Zero-shot CoTBackbone=Yi-1.5-9B, Prompting Strategy=Zero-shot CoT2024.0840—
Three-shot CoTBackbone=Qwen1.5-7B, Prompting Strategy=Three-shot CoT2024.0838.512.5
Step-BackBackbone=Qwen1.5-7B, Prompting Strategy=Step-Back2024.0836.518
One-shot CoTBackbone=Qwen1.5-7B, Prompting Strategy=One-shot CoT2024.0836.179.61
Zero-shot CoTBackbone=Qwen1.5-7B, Prompting Strategy=Zero-shot CoT2024.0833.5—
Zero-shot CoT + SCBackbone=Qwen1.5-7B, Prompting Strategy=Zero-shot CoT + SC2024.0833.50.33
Plan-and-SolveBackbone=Yi-1.5-9B, Prompting Strategy=Plan-and-Solve2024.0833.51.83