Operator Learning on Darcy interface problem nf=211, nc=61 (test)
0.844Relative ErrorGalerkin Transformer
Evaluation Results
| Method | Links | |
|---|---|---|
| Galerkin TransformerNormalization scheme=Galerkin projection-type Layer Normalization on K, V2021.05 | 0.844 | |
| Fourier TransformerNormalization scheme=regular Layer Normalization2021.05 | 0.847 | |
| Galerkin TransformerNormalization scheme=regular Layer Normalization2021.05 | 0.856 | |
| Fourier TransformerNormalization scheme=Galerkin projection-type Layer Normalization on Q, K2021.05 | 0.921 | |
| Softmax Transformer (ST)Normalization scheme=Galerkin projection-type Layer Normalization on Q, K2021.05 | 0.959 | |
| Linear Transformer (LT)Normalization scheme=Galerkin projection-type Layer Normalization on K, V2021.05 | 0.97 | |
| FNO2dTraining scheduler=original step scheduler (500 epochs)2021.05 | 1.09 | |
| Linear Transformer (LT)Normalization scheme=regular Layer Normalization2021.05 | 1.13 | |
| Softmax Transformer (ST)Normalization scheme=regular Layer Normalization2021.05 | 1.131 | |
| FNO2dTraining scheduler=1cycle (100 epochs)2021.05 | 1.424 |