Catalytic Activity on Mol-Instructions ID (test)
83.8E-BL2Llama-3.3 w/ RAPM
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Llama-3.3 w/ RAPMParam=70B2026.05 | 83.8 | 82.3 | 44.8 | 54.1 | |
| Gemini-3-Flash w/ 2D-ProteinRAGParam=N/A2026.05 | 73.8 | 67.5 | 44.7 | 61.4 | |
| Llama-3.1 w/ 2D-ProteinRAGParam=8B2026.05 | 72.3 | 66.3 | 45.2 | 60.5 | |
| Llama-3.3 w/ 2D-ProteinRAGParam=70B2026.05 | 68.6 | 63 | 40.2 | 53.7 | |
| GalacticaParam=1.3B2026.05 | 67.7 | 67.1 | 62.3 | 66.6 | |
| Gemini-3-Flash w/ BLASTParam=N/A2026.05 | 64 | 57.7 | 27.9 | 44.4 | |
| Gemini-3-Flash w/ RAPMParam=N/A2026.05 | 62.8 | 60.3 | 47.1 | 56.5 | |
| Llama-3.1 w/ RAPMParam=8B2026.05 | 61.3 | 59.4 | 48.8 | 53.9 | |
| Llama-3.1Param=8B2026.05 | 60.8 | 60.2 | 59.1 | 64.8 | |
| Llama-3.3 w/ BLASTParam=70B2026.05 | 60 | 54.5 | 25.3 | 36 | |
| BioGPTParam=347M2026.05 | 54.9 | 54 | 46 | 62.4 | |
| Protein2TextParam=8.65B2026.05 | 32.2 | 22.9 | 4.7 | 11.4 | |
| ProLLamaParam=8B2026.05 | 20.2 | 19.5 | 38.4 | 52.5 | |
| Llama-3.1 w/ BLASTParam=8B2026.05 | 17.6 | 14.2 | 15.1 | 21.8 | |
| Gemini-3-Flash w/ FewshotParam=N/A2026.05 | 0.8 | 0.6 | 11 | 29.7 | |
| Llama-3.1 w/ FewshotParam=8B2026.05 | 0 | 0 | 4.3 | 19.3 | |
| Llama-3.3 w/ FewshotParam=70B2026.05 | 0 | 0 | 6.2 | 21.7 |