Generation Speed on Sentiment Transformation Task
1.03Generation Speed (s/item)INJECTION
Evaluation Results
| Method | Links | |
|---|---|---|
| INJECTIONLLM Backbone=OPT 6.7B2024.02 | 1.03 | |
| INJECTIONLLM Backbone=Alpaca 7B2024.02 | 1.05 | |
| CONTINUATIONLLM Backbone=Alpaca 7B2024.02 | 1.07 | |
| INJECTIONLLM Backbone=Phi-2 2.7B2024.02 | 1.07 | |
| CONTINUATIONLLM Backbone=Phi-2 2.7B2024.02 | 1.17 | |
| CONTINUATIONLLM Backbone=OPT 6.7B2024.02 | 1.22 | |
| CONTINUATIONLLM Backbone=Falcon 7B2024.02 | 1.33 | |
| INJECTIONLLM Backbone=Falcon 7B2024.02 | 1.35 | |
| CONTINUATIONLLM Backbone=LLaMA-2 13B2024.02 | 1.58 | |
| INJECTIONLLM Backbone=LLaMA-2 13B2024.02 | 1.6 | |
| DATG-PLLM Backbone=Phi-2 2.7B2024.02 | 2.41 | |
| DATG-LLLM Backbone=Phi-2 2.7B2024.02 | 2.45 | |
| PREADDLLM Backbone=Phi-2 2.7B2024.02 | 2.84 | |
| DATG-LLLM Backbone=Alpaca 7B2024.02 | 3.59 | |
| DATG-PLLM Backbone=Alpaca 7B2024.02 | 3.61 | |
| DATG-LLLM Backbone=OPT 6.7B2024.02 | 3.95 | |
| DATG-PLLM Backbone=Falcon 7B2024.02 | 3.97 | |
| DATG-PLLM Backbone=OPT 6.7B2024.02 | 3.99 | |
| DATG-LLLM Backbone=Falcon 7B2024.02 | 4.01 | |
| PREADDLLM Backbone=Alpaca 7B2024.02 | 5.33 | |
| PREADDLLM Backbone=Falcon 7B2024.02 | 5.77 | |
| DATG-LLLM Backbone=LLaMA-2 13B2024.02 | 5.9 | |
| DATG-PLLM Backbone=LLaMA-2 13B2024.02 | 6.02 | |
| PREADDLLM Backbone=OPT 6.7B2024.02 | 6.35 | |
| FUDGELLM Backbone=Falcon 7B2024.02 | 6.43 | |
| FUDGELLM Backbone=Alpaca 7B2024.02 | 6.49 | |
| FUDGELLM Backbone=OPT 6.7B2024.02 | 6.59 | |
| FUDGELLM Backbone=Phi-2 2.7B2024.02 | 6.74 | |
| FUDGELLM Backbone=LLaMA-2 13B2024.02 | 7.01 | |
| PREADDLLM Backbone=LLaMA-2 13B2024.02 | 9.34 |