Scientific QA on Name conversion i2s
87Exact MatchSciReasoner
Evaluation Results
| Method | Links | |
|---|---|---|
| SciReasoner2026.07 | 87 | |
| Opus-4.72026.07 | 69 | |
| GPT-5.52026.07 | 58 | |
| DeepSeek-V4-Pro2026.07 | 35 | |
| Kimi-K2.62026.07 | 19 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| SciReasoner2026.07 | 87 | |
| Opus-4.72026.07 | 69 | |
| GPT-5.52026.07 | 58 | |
| DeepSeek-V4-Pro2026.07 | 35 | |
| Kimi-K2.62026.07 | 19 |