Inverse coefficient identification on Inverse Problem 5.3 nf, nc = 211, 71
0.0152Relative Error (x10^-2)Fourier Transformer
Evaluation Results
| Method | Links | |
|---|---|---|
| Fourier TransformerLayerNorm=on Q, K, Noise level (epsilon)=02021.05 | 0.0152 | |
| Fourier TransformerLayerNorm=regular Ln, Noise level (epsilon)=02021.05 | 0.0156 | |
| Galerkin TransformerLayerNorm=on K, V, Noise level (epsilon)=02021.05 | 0.0165 | |
| Galerkin TransformerLayerNorm=regular Ln, Noise level (epsilon)=02021.05 | 0.0173 | |
| Softmax TransformerLayerNorm=on Q, K, Noise level (epsilon)=02021.05 | 0.0189 | |
| Linear TransformerLayerNorm=regular Ln, Noise level (epsilon)=02021.05 | 0.0206 | |
| Softmax TransformerLayerNorm=regular Ln, Noise level (epsilon)=02021.05 | 0.0207 | |
| Linear TransformerLayerNorm=on K, V, Noise level (epsilon)=02021.05 | 0.0214 | |
| Fourier TransformerLayerNorm=on Q, K, Noise level (epsilon)=0.012021.05 | 0.0269 | |
| Fourier TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.012021.05 | 0.027 | |
| Galerkin TransformerLayerNorm=on K, V, Noise level (epsilon)=0.012021.05 | 0.0273 | |
| Galerkin TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.012021.05 | 0.0278 | |
| Softmax TransformerLayerNorm=on Q, K, Noise level (epsilon)=0.012021.05 | 0.0312 | |
| Softmax TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.012021.05 | 0.0337 | |
| Linear TransformerLayerNorm=on K, V, Noise level (epsilon)=0.012021.05 | 0.0354 | |
| Linear TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.012021.05 | 0.0354 | |
| Galerkin TransformerLayerNorm=on K, V, Noise level (epsilon)=0.12021.05 | 0.079 | |
| Galerkin TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.12021.05 | 0.0802 | |
| Fourier TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.12021.05 | 0.0811 | |
| Fourier TransformerLayerNorm=on Q, K, Noise level (epsilon)=0.12021.05 | 0.0829 | |
| Softmax TransformerLayerNorm=on Q, K, Noise level (epsilon)=0.12021.05 | 0.0879 | |
| Softmax TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.12021.05 | 0.0892 | |
| Linear TransformerLayerNorm=on K, V, Noise level (epsilon)=0.12021.05 | 0.0962 | |
| Linear TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.12021.05 | 0.0987 | |
| FNO2dinput_resolution=only nc, Noise level (epsilon)=02021.05 | 0.136 | |
| FNO2dinput_resolution=only nc, Noise level (epsilon)=0.012021.05 | 0.1369 | |
| FNO2dinput_resolution=only nf, Noise level (epsilon)=02021.05 | 0.1393 | |
| FNO2dinput_resolution=only nf, Noise level (epsilon)=0.012021.05 | 0.1396 | |
| FNO2dinput_resolution=only nf, Noise level (epsilon)=0.12021.05 | 0.1504 | |
| FNO2dinput_resolution=only nc, Noise level (epsilon)=0.12021.05 | 0.1604 |