OpenGen
Benchmarks
TaskDatasetSOTA resultTrendResults
OpenGen
90.62Bit Accuracy
20
OpenGen (test)
95.88Bit Accuracy (BA)
16
OpenGen 48 Bits payload (test)
3.58Perplexity
13
OpenGen 36 Bits payload (test)
3.61Perplexity
13
OpenGen 24 Bits payload (test)
3.51Perplexity
13
OpenGen 12 Bits payload (test)
3.53Perplexity
13
OpenGen 200 generated tokens (test)
3.84Perplexity (12 Bits)
13
OpenGen b=64
99.06BA
12
OpenGen b=32
100Bit Accuracy (BA)
12
OpenGen
100TPR
10
OpenGen 10% Insertion Attack
100TPR
10
OpenGen 10% Deletion Attack
100True Positive Rate (TPR)
10
OpenGen 10% Substitution Attack
100TPR
10
OpenGen OPT-6.7B
100TPR
8
OpenGen Llama-3.1-8B
100TPR
8
OpenGen 10% Editing
99.8TPR
3
OpenGen No Editing
1TPR
3