JFLEG
Benchmarks
TaskDatasetSOTA resultTrendResults
JFLEG (test)
64.9GLEU
60
JFLEG
63.3GLEU
47
Jfleg RTE (unseen)
0ASR
20
JFLEG (test)
61.61GLEU
12
Jfleg RTE
99.4Accuracy
10
JFLEG (dev)
63.61F0.5 Score
7
JFLEG-RTE
16.57Win Rate
5
Jfleg
7GCG ASR
2
Jfleg
99.5ASR
2
JFLEG (test)
72.53Precision
2
Jfleg
95.5GCG Accuracy
1