Inference Efficiency on HAGRID
4.75#MATSAM-Decoding[E2]
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SAM-Decoding[E2]Backbone=Vicuna-7B-v1.3, Auxiliary Method=EAGLE-2, Data Type=float16, Batch size=12024.11 | 4.75 | 96.6 | 2.81 | |
| EAGLE-2Backbone=Vicuna-7B-v1.3, Data Type=float16, Batch size=12024.11 | 4.15 | 82.61 | 2.41 | |
| SAM-Decoding[T]Backbone=Vicuna-7B-v1.3, Auxiliary Method=Token Recycling, Data Type=float16, Batch size=12024.11 | 3.23 | 87.93 | 2.57 | |
| Token RecyclingBackbone=Vicuna-7B-v1.3, Data Type=float16, Batch size=12024.11 | 2.88 | 66.17 | 1.93 | |
| SAM-DecodingBackbone=Vicuna-7B-v1.3, Data Type=float16, Batch size=12024.11 | 2.44 | 76.72 | 2.24 | |
| PIABackbone=Vicuna-7B-v1.3, Data Type=float16, Batch size=12024.11 | 2.43 | 66.65 | 1.95 | |
| PLDBackbone=Vicuna-7B-v1.3, Data Type=float16, Batch size=12024.11 | 2.03 | 44.11 | 1.29 | |
| REST*Backbone=Vicuna-7B-v1.3, Data Type=float16, Batch size=12024.11 | 1.53 | 24.91 | 1.39 | |
| Lookahead*Backbone=Vicuna-7B-v1.3, Data Type=float16, Batch size=12024.11 | 1.46 | 23.58 | 1.32 |