Inference Performance (Throughput/Memory) on Mathematical Reasoning Task
639.7Throughput (Token/s)FWSVD
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FWSVDModel Size (Billion)=0.472025.07 | 639.7 | 4.38 | |
| IMPACTModel Size (Billion)=0.752025.07 | 616.01 | 5.41 | |
| SVDModel Size (Billion)=0.562025.07 | 607.92 | 4.7 | |
| IMPACTModel Size (Billion)=1.192025.07 | 568.04 | 7.25 | |
| AFMModel Size (Billion)=0.832025.07 | 566.43 | 5.76 | |
| FWSVDModel Size (Billion)=0.962025.07 | 553.89 | 6.62 | |
| SVDModel Size (Billion)=1.112025.07 | 545.19 | 6.9 | |
| AFMModel Size (Billion)=1.302025.07 | 538.42 | 7.7 | |
| FWSVDModel Size (Billion)=1.542025.07 | 506.01 | 9.04 | |
| IMPACTModel Size (Billion)=1.672025.07 | 505.74 | 9.25 | |
| SVDModel Size (Billion)=1.732025.07 | 489 | 9.75 | |
| AFMModel Size (Billion)=1.902025.07 | 470.98 | 10.21 | |
| IMPACTModel Size (Billion)=2.402025.07 | 445.16 | 12.21 | |
| AFMModel Size (Billion)=2.662025.07 | 414.04 | 13.24 | |
| IMPACTModel Size (Billion)=3.112025.07 | 414.03 | 14.99 | |
| FWSVDModel Size (Billion)=2.952025.07 | 402.54 | 14.56 | |
| SVDModel Size (Billion)=3.182025.07 | 373.47 | 15.34 | |
| AFMModel Size (Billion)=3.622025.07 | 344.59 | 17.03 | |
| FWSVDModel Size (Billion)=4.792025.07 | 341.3 | 21.93 | |
| SVDModel Size (Billion)=5.032025.07 | 321.71 | 22.73 | |
| SVDModel Size (Billion)=6.742025.07 | 261.74 | 29.26 | |
| FWSVDModel Size (Billion)=6.742025.07 | 261.74 | 29.26 | |
| AFMModel Size (Billion)=6.742025.07 | 261.74 | 29.26 | |
| IMPACTModel Size (Billion)=6.742025.07 | 261.74 | 29.26 |