Keyword recovery on Pfam700 Func2Seq
67.8Pass@1 (T=0.3)Progen2-medium-mix7 BRO
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Progen2-medium-mix7 BROModel size=764M, Decoding strategy=top-k decoding (k=15)2026.06 | 67.8 | 69.7 | 70.1 | 64.5 | 34.2 | 61.3 | |
| Progen2-medium-mix7 OracleModel size=764M, Decoding strategy=top-k decoding (k=15)2026.06 | 66.1 | 70 | 70.4 | 64.2 | 30.8 | 60.3 | |
| Progen2-medium-mix7 SROModel size=764M, Decoding strategy=top-k decoding (k=15)2026.06 | 65.5 | 70.6 | 70.8 | 64.8 | 29.2 | 60.2 | |
| Progen2-medium-mix7 DPOModel size=764M, Decoding strategy=top-k decoding (k=15)2026.06 | 59.1 | 69.3 | 67 | 37.9 | 6.7 | 48 | |
| Progen2-small-mix7 OracleModel size=151M, Decoding strategy=top-k decoding (k=15)2026.06 | 53.7 | 57.3 | 57.9 | 50.6 | 24.7 | 48.8 | |
| Progen2-medium-mix7 KTOModel size=764M, Decoding strategy=top-k decoding (k=15)2026.06 | 50.7 | 62 | 68.1 | 55.7 | 15.9 | 50.5 | |
| Progen2-small-mix7 BROModel size=151M, Decoding strategy=top-k decoding (k=15)2026.06 | 40.6 | 44.5 | 49.4 | 52 | 29.8 | 43.3 | |
| Progen2-small-mix7 SROModel size=151M, Decoding strategy=top-k decoding (k=15)2026.06 | 38.3 | 45.5 | 49.8 | 49.9 | 30.1 | 42.7 | |
| Progen2-medium-mix7Model size=764M, Decoding strategy=top-k decoding (k=15)2026.06 | 38.3 | 47.1 | 56.7 | 42.8 | 7.4 | 38.5 | |
| Progen2-small-mix7 DPOModel size=151M, Decoding strategy=top-k decoding (k=15)2026.06 | 28.3 | 39.5 | 51.2 | 43.5 | 12.2 | 35 | |
| Progen2-small-mix7 KTOModel size=151M, Decoding strategy=top-k decoding (k=15)2026.06 | 27.2 | 34.7 | 43 | 45.8 | 17.5 | 33.7 | |
| Progen2-small-mix7Model size=151M, Decoding strategy=top-k decoding (k=15)2026.06 | 21 | 28.8 | 39 | 40.1 | 11.8 | 28.1 |