EV Demand Forecasting on Palo Alto Step 6
0.6726Average Quantile ScoreLSTM-FedAvg
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| LSTM-FedAvgForecasting Model=LSTM, FL Method=FedAvg2024.04 | 0.6726 | 0.5818 | 0.789 | 0.7603 | 0.4764 | 0.7955 | 0.7921 | 0.4762 | 0.7095 | 50 | |
| LSTM-PFLForecasting Model=LSTM, FL Method=PFL2024.04 | 0.691 | 0.5702 | 0.8309 | 0.7679 | 0.4802 | 0.7899 | 0.8676 | 0.4973 | 0.7269 | 25 | |
| LSTM-FedProxForecasting Model=LSTM, FL Method=FedProx2024.04 | 0.7063 | 0.7748 | 0.8154 | 0.7662 | 0.7463 | 0.7776 | 0.8366 | 0.4702 | 0.7063 | 50 | |
| LSTM-pFedMeForecasting Model=LSTM, FL Method=pFedMe2024.04 | 0.732 | 0.7408 | 0.7884 | 0.789 | 0.735 | 0.788 | 0.8185 | 0.476 | 0.7201 | 50 | |
| CNFGNNForecasting Model=CNFGNN, FL Method=CNFGNN2024.04 | 0.739 | 0.7404 | 0.7411 | 0.7355 | 0.7563 | 0.7021 | 0.7206 | 0.764 | 0.7521 | 25 | |
| GCRN-FedAvgForecasting Model=GCRN, FL Method=FedAvg2024.04 | 0.7448 | 0.7473 | 0.7096 | 0.743 | 0.7653 | 0.7052 | 0.7563 | 0.7631 | 0.7604 | 37.5 | |
| LSTM-CNN-FedAvgForecasting Model=LSTM-CNN, FL Method=FedAvg2024.04 | 0.7455 | 0.7194 | 0.7039 | 0.7642 | 0.7449 | 0.7372 | 0.7757 | 0.7631 | 0.7555 | 25 | |
| PAG-FedAvgForecasting Model=PAG, FL Method=FedAvg2024.04 | 0.7534 | 0.7748 | 0.7587 | 0.7344 | 0.7772 | 0.733 | 0.7902 | 0.7609 | 0.698 | 37.5 | |
| LSTM-CNN-PFLForecasting Model=LSTM-CNN, FL Method=PFL2024.04 | 0.7554 | 0.7749 | 0.7466 | 0.7644 | 0.7616 | 0.743 | 0.8038 | 0.7376 | 0.7111 | 50 | |
| No FLForecasting Model=LSTM, FL Method=—2024.04 | 0.7585 | 0.7353 | 0.7713 | 0.7488 | 0.7734 | 0.7419 | 0.7902 | 0.7481 | 0.7592 | 0 | |
| GraphSAGE-FedAvgForecasting Model=GraphSAGE, FL Method=FedAvg2024.04 | 0.7606 | 0.7684 | 0.7364 | 0.7723 | 0.7678 | 0.741 | 0.7774 | 0.7604 | 0.7615 | 50 | |
| PFGLForecasting Model=STAGCN, FL Method=PFL2024.04 | 0.7684 | 0.7749 | 0.7643 | 0.7896 | 0.7783 | 0.7439 | 0.7862 | 0.7495 | 0.7607 | 75 | |
| CentralForecasting Model=LSTM, FL Method=—2024.04 | 0.8285 | — | — | — | — | — | — | — | — | — | |
| CentralForecasting Model=LSTM, FL Method=—2024.04 | 1.0974 | — | — | — | — | — | — | — | — | — | |
| PFGLForecasting Model=STAGCN, FL Method=PFL2024.04 | 1.318 | 1.3768 | 1.5469 | 1.3099 | 1.1325 | 1.6801 | 1.5183 | 0.9503 | 1.029 | 100 | |
| GraphSAGE-FedAvgForecasting Model=GraphSAGE, FL Method=FedAvg2024.04 | 1.3504 | 1.3728 | 1.5926 | 1.3267 | 1.1454 | 1.7651 | 1.5383 | 0.9799 | 1.0825 | 100 | |
| CNFGNNForecasting Model=CNFGNN, FL Method=CNFGNN2024.04 | 1.3525 | 1.3489 | 1.5789 | 1.3559 | 1.1612 | 1.7699 | 1.5729 | 0.9532 | 1.0793 | 100 | |
| LSTM-pFedMeForecasting Model=LSTM, FL Method=pFedMe2024.04 | 1.3892 | 1.3558 | 1.7227 | 1.3416 | 1.1548 | 1.7239 | 1.619 | 1.0229 | 1.1726 | 87.5 | |
| LSTM-FedProxForecasting Model=LSTM, FL Method=FedProx2024.04 | 1.4217 | 1.3506 | 1.7284 | 1.3749 | 1.2324 | 1.7284 | 1.5606 | 1.1098 | 1.2883 | 62.5 | |
| GCRN-FedAvgForecasting Model=GCRN, FL Method=FedAvg2024.04 | 1.4219 | 1.4513 | 1.6698 | 1.4843 | 1.1903 | 1.8284 | 1.6623 | 1.0062 | 1.0826 | 100 | |
| LSTM-CNN-PFLForecasting Model=LSTM-CNN, FL Method=PFL2024.04 | 1.4252 | 1.4756 | 1.6808 | 1.4452 | 1.1794 | 1.839 | 1.6718 | 1.0113 | 1.0986 | 100 | |
| LSTM-CNN-FedAvgForecasting Model=LSTM-CNN, FL Method=FedAvg2024.04 | 1.4267 | 1.4921 | 1.6805 | 1.416 | 1.1844 | 1.861 | 1.6717 | 1.0111 | 1.0968 | 100 | |
| LSTM-PFLForecasting Model=LSTM, FL Method=PFL2024.04 | 1.4588 | 1.5107 | 1.6504 | 1.4995 | 1.2037 | 1.7949 | 1.6674 | 1.1186 | 1.225 | 75 | |
| LSTM-FedAvgForecasting Model=LSTM, FL Method=FedAvg2024.04 | 1.4846 | 1.5075 | 1.6605 | 1.5281 | 1.214 | 1.8111 | 1.7175 | 1.1534 | 1.2843 | 75 | |
| No_FLForecasting Model=LSTM, FL Method=—2024.04 | 1.5228 | 1.6377 | 1.8104 | 1.5343 | 1.2219 | 1.8841 | 1.8705 | 1.1031 | 1.1208 | 0 | |
| PAG-FedAvgForecasting Model=PAG, FL Method=FedAvg2024.04 | 1.5304 | 1.4939 | 1.7666 | 1.5963 | 1.3152 | 2.004 | 1.7644 | 1.044 | 1.2587 | 100 | |
| PFGLForecasting Model=STAGCN, FL Method=PFL2024.04 | 3.9813 | 4.1713 | 4.4544 | 3.701 | 3.5485 | 4.7736 | 5.0187 | 2.9461 | 3.2368 | 100 | |
| CNFGNNForecasting Model=CNFGNN, FL Method=CNFGNN2024.04 | 4.0656 | 4.2927 | 4.5791 | 3.7782 | 3.7633 | 4.5811 | 5.1661 | 3.0256 | 3.3389 | 100 | |
| GraphSAGE-FedAvgForecasting Model=GraphSAGE, FL Method=FedAvg2024.04 | 4.0858 | 4.3044 | 4.4738 | 3.7838 | 3.6303 | 4.6727 | 5.2961 | 2.9537 | 3.5716 | 100 | |
| LSTM-CNN-PFLForecasting Model=LSTM-CNN, FL Method=PFL2024.04 | 4.1525 | 4.4348 | 4.7678 | 3.8686 | 3.6398 | 4.9492 | 5.3042 | 3.0571 | 3.1986 | 100 | |
| LSTM-CNN-FedAvgForecasting Model=LSTM-CNN, FL Method=FedAvg2024.04 | 4.2358 | 4.2879 | 4.7923 | 4.1441 | 3.7645 | 4.8621 | 5.6288 | 3.1034 | 3.3035 | 100 | |
| PAG-FedAvgForecasting Model=PAG, FL Method=FedAvg2024.04 | 4.2462 | 4.4805 | 4.7293 | 3.6626 | 4.3968 | 4.9122 | 5.3385 | 3.2354 | 3.2142 | 100 | |
| GCRN-FedAvgForecasting Model=GCRN, FL Method=FedAvg2024.04 | 4.2518 | 4.3415 | 4.7192 | 4.0985 | 4.0128 | 4.9653 | 5.1394 | 3.1249 | 3.6126 | 100 | |
| CentralForecasting Model=LSTM, FL Method=—2024.04 | 4.2677 | — | — | — | — | — | — | — | — | — | |
| LSTM-PFLForecasting Model=LSTM, FL Method=PFL2024.04 | 4.4356 | 4.892 | 5.2963 | 4.3127 | 3.4221 | 5.1952 | 6.239 | 3.0354 | 3.2 | 63.3 | |
| LSTM-FedProxForecasting Model=LSTM, FL Method=FedProx2024.04 | 4.4788 | 5.0022 | 5.3836 | 4.2921 | 3.3704 | 5.2858 | 6.5579 | 2.9011 | 3.037 | 62.5 | |
| LSTM-pFedMeForecasting Model=LSTM, FL Method=pFedMe2024.04 | 4.527 | 4.2383 | 5.317 | 5.317 | 5.317 | 5.2964 | 6.7345 | 3.2764 | 3.3657 | 87.5 | |
| LSTM-FedAvgForecasting Model=LSTM, FL Method=FedAvg2024.04 | 4.5517 | 5.014 | 5.3843 | 4.4358 | 3.4362 | 5.3279 | 6.7106 | 2.9766 | 3.1284 | 63.3 | |
| No_FLForecasting Model=LSTM, FL Method=—2024.04 | 4.711 | 4.8827 | 5.453 | 4.2709 | 4.1653 | 5.4922 | 6.2315 | 3.708 | 3.484 | 0 |