List your company
ResearchFormerly WizWand

Operator Learning on Darcy interface problem nf=211, nc=61 (test)

0.844Relative ErrorGalerkin Transformer
0.82080.97741.1341.2906May 31, 2021
Updated 8mo ago

Evaluation results

MethodLinks
Galerkin TransformerNormalization scheme=Galerkin projection-type Layer Normalization on K, V2021.050.844
Fourier TransformerNormalization scheme=regular Layer Normalization2021.050.847
Galerkin TransformerNormalization scheme=regular Layer Normalization2021.050.856
Fourier TransformerNormalization scheme=Galerkin projection-type Layer Normalization on Q, K2021.050.921
Softmax Transformer (ST)Normalization scheme=Galerkin projection-type Layer Normalization on Q, K2021.050.959
Linear Transformer (LT)Normalization scheme=Galerkin projection-type Layer Normalization on K, V2021.050.97
FNO2dTraining scheduler=original step scheduler (500 epochs)2021.051.09
Linear Transformer (LT)Normalization scheme=regular Layer Normalization2021.051.13
Softmax Transformer (ST)Normalization scheme=regular Layer Normalization2021.051.131
FNO2dTraining scheduler=1cycle (100 epochs)2021.051.424