First Integral Prediction on First Integral Discovery Hard (test)
63.7AccuracyFISolver-Base
Evaluation Results
| Method | Links | |
|---|---|---|
| FISolver-Basebeam size (bs)=70, Training Strategy=RL, RL Training Data=HardSplit (HS), RL Reward Scheme=LD-based Reward (LD)2026.05 | 63.7 | |
| FISolver-Basebeam size (bs)=70, Training Strategy=RL, RL Training Data=HardSplit (HS), RL Reward Scheme=Binary Reward (Bin)2026.05 | 63.3 | |
| FISolver-Basebeam size (bs)=70, Training Strategy=SFT-only2026.05 | 62.2 | |
| FISolver-Basebeam size (bs)=70, Training Strategy=RL, RL Training Data=NormalSplit (NS), RL Reward Scheme=LD-based Reward (LD)2026.05 | 61.5 | |
| FISolver-Basebeam size (bs)=70, Training Strategy=RL, RL Training Data=NormalSplit (NS), RL Reward Scheme=Binary Reward (Bin)2026.05 | 59.9 | |
| FISolver-Basebeam size (bs)=5, Training Strategy=RL, RL Training Data=HardSplit (HS), RL Reward Scheme=LD-based Reward (LD)2026.05 | 33.5 | |
| FISolver-Basebeam size (bs)=5, Training Strategy=RL, RL Training Data=NormalSplit (NS), RL Reward Scheme=LD-based Reward (LD)2026.05 | 31 | |
| FISolver-Basebeam size (bs)=5, Training Strategy=RL, RL Training Data=NormalSplit (NS), RL Reward Scheme=Binary Reward (Bin)2026.05 | 29.3 | |
| FISolver-Basebeam size (bs)=5, Training Strategy=SFT-only2026.05 | 26.1 | |
| FISolver-Basebeam size (bs)=5, Training Strategy=RL, RL Training Data=HardSplit (HS), RL Reward Scheme=Binary Reward (Bin)2026.05 | 26 | |
| Mathematica2026.05 | 23.3 | |
| Qwen2.5-Math-7Bbeam size (bs)=52026.05 | 2.6 | |
| Qwen2.5-Math-1.5Bbeam size (bs)=52026.05 | 2.4 |