Inverse coefficient identification on Inverse Problem 5.3 nf, nc = 141, 36
0.018Relative ErrorFourier Transformer
Evaluation Results
| Method | Links | |
|---|---|---|
| Fourier TransformerLayerNorm=regular Ln, Noise level (epsilon)=02021.05 | 0.018 | |
| Fourier TransformerLayerNorm=on Q, K, Noise level (epsilon)=02021.05 | 0.0192 | |
| Galerkin TransformerLayerNorm=on K, V, Noise level (epsilon)=02021.05 | 0.0194 | |
| Galerkin TransformerLayerNorm=regular Ln, Noise level (epsilon)=02021.05 | 0.0203 | |
| Softmax TransformerLayerNorm=on Q, K, Noise level (epsilon)=02021.05 | 0.0216 | |
| Linear TransformerLayerNorm=regular Ln, Noise level (epsilon)=02021.05 | 0.0225 | |
| Linear TransformerLayerNorm=on K, V, Noise level (epsilon)=02021.05 | 0.0236 | |
| Softmax TransformerLayerNorm=regular Ln, Noise level (epsilon)=02021.05 | 0.0243 | |
| Fourier TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.012021.05 | 0.0247 | |
| Galerkin TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.012021.05 | 0.0254 | |
| Galerkin TransformerLayerNorm=on K, V, Noise level (epsilon)=0.012021.05 | 0.0255 | |
| Fourier TransformerLayerNorm=on Q, K, Noise level (epsilon)=0.012021.05 | 0.0272 | |
| Softmax TransformerLayerNorm=on Q, K, Noise level (epsilon)=0.012021.05 | 0.0281 | |
| Softmax TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.012021.05 | 0.0311 | |
| Linear TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.012021.05 | 0.0319 | |
| Linear TransformerLayerNorm=on K, V, Noise level (epsilon)=0.012021.05 | 0.032 | |
| Galerkin TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.12021.05 | 0.0666 | |
| Galerkin TransformerLayerNorm=on K, V, Noise level (epsilon)=0.12021.05 | 0.0669 | |
| Fourier TransformerLayerNorm=on Q, K, Noise level (epsilon)=0.12021.05 | 0.0673 | |
| Fourier TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.12021.05 | 0.0681 | |
| Softmax TransformerLayerNorm=on Q, K, Noise level (epsilon)=0.12021.05 | 0.07 | |
| Softmax TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.12021.05 | 0.0743 | |
| Linear TransformerLayerNorm=on K, V, Noise level (epsilon)=0.12021.05 | 0.0866 | |
| Linear TransformerLayerNorm=regular Ln, Noise level (epsilon)=0.12021.05 | 0.0906 | |
| FNO2dinput_resolution=only nf, Noise level (epsilon)=02021.05 | 0.1371 | |
| FNO2dinput_resolution=only nf, Noise level (epsilon)=0.012021.05 | 0.1378 | |
| FNO2dinput_resolution=only nc, Noise level (epsilon)=02021.05 | 0.1417 | |
| FNO2dinput_resolution=only nc, Noise level (epsilon)=0.012021.05 | 0.1431 | |
| FNO2dinput_resolution=only nf, Noise level (epsilon)=0.12021.05 | 0.1512 | |
| FNO2dinput_resolution=only nc, Noise level (epsilon)=0.12021.05 | 0.173 |