Sequence Reconstruction on CoLA
99.6ROUGE-1DAGER
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DAGERBatch size=1, Target Model=BERTBase2026.04 | 99.6 | 99.3 | 99.1 | |
| DAGERBatch size=2, Target Model=BERTBase2026.04 | 97.8 | 97.1 | 93.6 | |
| FEDSPY-LLMBatch size=1, Target Model=BERTBase2026.04 | 94.5 | 93.9 | 92.8 | |
| FEDSPY-LLMBatch size=2, Target Model=BERTBase2026.04 | 93.7 | 92.1 | 90.1 | |
| FEDSPY-LLMBatch size=4, Target Model=BERTBase2026.04 | 91.9 | 90.4 | 87.2 | |
| DAGERBatch size=4, Target Model=BERTBase2026.04 | 89.6 | 84.9 | 81.5 | |
| BGPBatch size=1, Target Model=BERTBase2026.04 | 85.8 | 50.7 | 75.9 | |
| FILMBatch size=1, Target Model=BERTBase2026.04 | 84 | 44.6 | 71.8 | |
| LAMPBatch size=1, Target Model=BERTBase2026.04 | 83.9 | 45.5 | 72.4 | |
| APRILBatch size=1, Target Model=BERTBase2026.04 | 83.8 | 45.3 | 72.1 | |
| FEDSPY-LLMBatch size=8, Target Model=BERTBase2026.04 | 79.8 | 71.9 | 64.7 | |
| TAGBatch size=1, Target Model=BERTBase2026.04 | 78.1 | 10 | 52.7 | |
| BGPBatch size=2, Target Model=BERTBase2026.04 | 68.7 | 30.6 | 59.9 | |
| DAGERBatch size=8, Target Model=BERTBase2026.04 | 63.6 | 44.3 | 43.9 | |
| DLGBatch size=1, Target Model=BERTBase2026.04 | 58.6 | 7.6 | 45.5 | |
| FILMBatch size=2, Target Model=BERTBase2026.04 | 56.6 | 18.9 | 49.2 | |
| LAMPBatch size=2, Target Model=BERTBase2026.04 | 56.4 | 21.4 | 49.1 | |
| APRILBatch size=2, Target Model=BERTBase2026.04 | 56.2 | 21.5 | 48.9 | |
| BGPBatch size=4, Target Model=BERTBase2026.04 | 49.8 | 11.5 | 43.2 | |
| TAGBatch size=2, Target Model=BERTBase2026.04 | 44.9 | 4.5 | 36.2 | |
| FILMBatch size=4, Target Model=BERTBase2026.04 | 43.2 | 11.1 | 39.6 | |
| APRILBatch size=4, Target Model=BERTBase2026.04 | 40.6 | 7.6 | 39.5 | |
| BGPBatch size=8, Target Model=BERTBase2026.04 | 40.1 | 8 | 37.6 | |
| LAMPBatch size=4, Target Model=BERTBase2026.04 | 39.8 | 6.2 | 35.6 | |
| FILMBatch size=8, Target Model=BERTBase2026.04 | 37.1 | 5.7 | 34.2 | |
| APRILBatch size=8, Target Model=BERTBase2026.04 | 36.6 | 5 | 33.8 | |
| DLGBatch size=2, Target Model=BERTBase2026.04 | 36.2 | 2.5 | 30.9 | |
| LAMPBatch size=8, Target Model=BERTBase2026.04 | 35.8 | 4.9 | 33.9 | |
| TAGBatch size=4, Target Model=BERTBase2026.04 | 34.9 | 1.5 | 30.8 | |
| DLGBatch size=4, Target Model=BERTBase2026.04 | 34.8 | 1.3 | 31.4 | |
| TAGBatch size=8, Target Model=BERTBase2026.04 | 32.8 | 1.5 | 29.9 | |
| DLGBatch size=8, Target Model=BERTBase2026.04 | 16.1 | 0.7 | 7.6 |