List your company

Legal Document Generation on Legal Document Drafting Dataset (test)

0.15RL ScoreWrapper (Over LLaMA-3.1-8B)
0.07720.09610.1150.1339Apr 4, 2025

Evaluation results

MethodLinks
Wrapper (Over LLaMA-3.1-8B)Base Model=LLaMA-3.1-8B, Prompting Strategy=Wrapper2025.040.150.040.180.790.195.153.32.2
Wrapper (Over Gemma-3-12B)Base Model=Gemma-3-12B, Prompting Strategy=Wrapper2025.040.150.060.240.80.176.568.827.82
GPT-4oBase Model=GPT-4o2025.040.140.030.120.810.246.688.85.4
Gemma-3-12B-It SFTBase Model=Gemma-3-12B, Prompting Strategy=Instruct, Fine-tuning Strategy=SFT2025.040.110.010.10.780.041.3711
Qwen3-14BBase Model=Qwen3-14B2025.040.0900.070.730.013.5611
LLaMA-3.1-8B-InstructBase Model=LLaMA-3.1-8B, Prompting Strategy=Instruct2025.040.090.010.110.780.041.5711.1
Gemma-3-12B-ItBase Model=Gemma-3-12B, Prompting Strategy=Instruct2025.040.090.010.10.760.021.1311
LLaMA-3.1-8B-Instruct SFTBase Model=LLaMA-3.1-8B, Prompting Strategy=Instruct, Fine-tuning Strategy=SFT2025.040.0800.050.740.011.1211