Antibody Generation on Paired OAS (test)
0.5308W1 (Natural)Transformer
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| TransformerBackbone=Transformer2023.07 | 0.5308 | 0.441 | 1.2284 | 25.8265 | 0.2324 | 0.2278 | 2.7925 | — | — | |
| TransformerBackbone=Transformer, AHo numbering=true, Position-specific residue frequencies=true2023.07 | 0.4456 | 0.3474 | 0.5351 | 6.449 | 0.1641 | 0.0593 | 2.3472 | — | — | |
| FA-GNNBackbone=FA-GNN2023.07 | 0.4141 | 0.2822 | 0.4302 | 2.533 | 0.1696 | 0.1164 | 1.7886 | 22.7988 | 0.8617 | |
| EGNNBackbone=EGNN2023.07 | 0.3988 | 0.2655 | 0.3547 | 2.1115 | 0.1486 | 0.1085 | 1.9881 | 1,586.016 | 9.8231 | |
| EGNNBackbone=EGNN, AHo numbering=true, Learned covariance=true2023.07 | 0.3482 | 0.2374 | 0.2443 | 2.5632 | 0.119 | 0.0462 | 1.2184 | 1,015.8926 | 9.4814 | |
| FA-GNNBackbone=FA-GNN, AHo numbering=true2023.07 | 0.3407 | 0.2263 | 0.2344 | 2.3272 | 0.1411 | 0.1306 | 1.6046 | 8.7506 | 0.8321 | |
| EGNNBackbone=EGNN, AHo numbering=true2023.07 | 0.3329 | 0.2229 | 0.2904 | 8.162 | 0.1263 | 0.1075 | 0.7978 | 1,714.2734 | 10.0628 | |
| AbDiffuserPrior distribution=uniform2023.07 | 0.2837 | 0.1419 | 0.2188 | 3.1364 | 0.0727 | 0.1691 | 1.3874 | 38.8417 | 0.8398 | |
| FA-GNNBackbone=FA-GNN, AHo numbering=true, Learned covariance=true2023.07 | 0.2785 | 0.1669 | 0.0815 | 5.444 | 0.0493 | 0.0212 | 0.7768 | 15.367 | 0.8814 | |
| AbDiffuserProjection layer=false2023.07 | 0.2378 | 0.1529 | 0.0694 | 2.353 | 0.0637 | 0.0793 | 0.7376 | 6,313.2495 | 11.1431 | |
| AbDiffuserLearned covariance=false2023.07 | 0.2309 | 0.1107 | 0.1235 | 1.2392 | 0.0664 | 0.0511 | 0.6453 | 17.7322 | 0.6302 | |
| AbDiffuserFull model=true2023.07 | 0.1979 | 0.0921 | 0.0662 | 2.3219 | 0.0314 | 0.0285 | 0.6662 | 13.3051 | 0.523 | |
| dyMEAN2023.07 | 0.1319 | 0.16 | 0.0423 | 3.9145 | 0.1566 | 0.2929 | 2.3711 | 601.1153 | 3.8157 | |
| IgLMNote=Trained on significantly more data including test set, Bootstrap generation=sequence-based2023.07 | 0.1103 | 0.0484 | 0.0577 | 11.0675 | 0.0413 | 0.0671 | 1.9274 | — | — | |
| AbDiffuserSide chain modeling=true2023.07 | 0.0916 | 0.052 | 0.0186 | 6.3166 | 0.0209 | 0.0754 | 0.8676 | 16.6117 | 0.4962 | |
| Validation Set Baseline2023.07 | 0.015 | 0.0043 | 0.0102 | 0.8301 | 0.0441 | 0.0176 | 0.4889 | 1.0814 | — |