Financial Open-ended Question Answering on FinQA (test)
3.9697Token PerplexityDEEPFUSION
Evaluation results
| Method | Links | |
|---|---|---|
| DEEPFUSIONNumber of participating edge devices (N)=162026.02 | 3.9697 | |
| DEEPFUSIONNumber of participating edge devices (N)=322026.02 | 3.97 | |
| FedJETSNumber of participating edge devices (N)=162026.02 | 3.9717 | |
| DEEPFUSIONNumber of participating edge devices (N)=1282026.02 | 3.9723 | |
| DEEPFUSIONNumber of participating edge devices (N)=642026.02 | 3.9774 | |
| FedKMTNumber of participating edge devices (N)=322026.02 | 3.9811 | |
| FedJETSNumber of participating edge devices (N)=322026.02 | 3.9863 | |
| FedKMTNumber of participating edge devices (N)=162026.02 | 3.9908 | |
| FedKMTNumber of participating edge devices (N)=642026.02 | 3.9941 | |
| FedJETSNumber of participating edge devices (N)=642026.02 | 3.9987 | |
| FedJETSNumber of participating edge devices (N)=1282026.02 | 4.0006 | |
| FedKMTNumber of participating edge devices (N)=1282026.02 | 4.003 | |
| OFA-KDNumber of participating edge devices (N)=642026.02 | 4.0224 | |
| OFA-KDNumber of participating edge devices (N)=1282026.02 | 4.0333 | |
| OFA-KDNumber of participating edge devices (N)=162026.02 | 4.0375 | |
| OFA-KDNumber of participating edge devices (N)=322026.02 | 4.0398 |