Hardware Resource and Performance Evaluation on FPGA Hardware Implementation
0DSPGelu
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GeluData Type=FP322026.03 | 0 | — | — | 2,499 | 11,314 | |
| SoftmaxData Type=FP322026.03 | 0 | — | — | 13,837 | 238,569 | |
| G&SData Type=Fix16, Note=Reconfigurable to approximate GELU or Softmax Exp2026.03 | 0 | — | — | 1,024 | 4,897 | |
| D(16) (Ours)Data Type=Fix16, Note=Reconfigurable to approximate GELU or Softmax Exp2026.03 | 1 | 20 | — | 100 | 401 | |
| DS(16) (Ours)Data Type=Fix16, Integration=Integrating DAPA into the Full Softmax Unit2026.03 | 1 | 155 | — | 2,243 | 1,614 | |
| D(16) (Ours)Data Type=FP32, Note=Reconfigurable to approximate GELU or Softmax Exp2026.03 | 7 | 150 | 2 | 1,304 | 1,100 | |
| Gelu (Ours)Data Type=Fix162026.03 | 8 | 320 | — | 5,858 | 6,302 | |
| GeluData Type=Fix162026.03 | 16 | — | — | 2,951 | 2,940 | |
| SoftmaxData Type=Fix162026.03 | 48 | — | — | 3,831 | 5,595 | |
| Gelu (Ours)Data Type=FP322026.03 | 62 | 580 | 5 | 12,158 | 7,228 |