Code Generation on HE
77.44HE ScoreOPTIMER
Evaluation Results
| Method | Links | |
|---|---|---|
| OPTIMERBase Model=SEA-LION v42026.03 | 77.44 | |
| OPTIMERBase Model=Gemma 3 27B2026.03 | 70.12 | |
| SEA-LION v4 27B IT2026.03 | 5.49 | |
| Gemma 3 27B IT2026.03 | 2.44 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| OPTIMERBase Model=SEA-LION v42026.03 | 77.44 | |
| OPTIMERBase Model=Gemma 3 27B2026.03 | 70.12 | |
| SEA-LION v4 27B IT2026.03 | 5.49 | |
| Gemma 3 27B IT2026.03 | 2.44 |