Law
Benchmarks
TaskDatasetSOTA resultTrendResults
Law
70.25Accuracy
27
Law
132.69Throughput (tokens/s)
22
Law
100Validity
18
Law
34.4LLM-as-judge Score
13
Law
26.52Score
13
Law (test)
61.55BLEU
9
Law
45.4Accuracy
8
Law
69.1Accuracy
8
Law (Ko-En) (test)
53.8BLEU
8
Law De-En (test)
75.44BLEU
8
Law All-domain datastore (test)
61.22BLEU
6
Law (test)
45.29Score
5
Law En-De out-of-domain WMT14 (test)
41.5BLEU Score
5
Law
1.97Verification Time (s)
4
Law
1.34Verification Time (s)
4
Law Unsafe vs. Safe v3/v4 (holdout)
0.971AUROC
2
Law multi-domain (test)
3,690.85Decoding Speed (Tok/Sec)
2