Structured Prediction on EPPC Miner (test)
79.08Code PrecisionSTaR-DRO
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| STaR-DROModel=Llama-3.3-70B-Instruct2026.04 | 79.08 | 84 | 81.47 | 66.26 | 72.64 | 69.3 | 87.57 | 96.3 | 91.73 | |
| STaR-DROModel=Llama-3.2-3B-Instruct2026.04 | 78.13 | 81.91 | 79.98 | 63.28 | 69.04 | 66.03 | 86.46 | 96.05 | 91 | |
| Standard DROModel=Llama-3.3-70B-Instruct2026.04 | 77.42 | 82.79 | 80.02 | 65.9 | 71.7 | 68.68 | 87.81 | 96.05 | 91.74 | |
| SFTModel=Llama-3.3-70B-Instruct2026.04 | 77.41 | 81.16 | 79.24 | 65.92 | 69.75 | 67.78 | 89.97 | 94.93 | 92.38 | |
| STaR-DROModel=Llama-3.1-8B-Instruct2026.04 | 77.35 | 82.33 | 79.77 | 63.83 | 70.05 | 66.8 | 86.66 | 96.74 | 91.42 | |
| SFTModel=Llama-3.2-3B-Instruct2026.04 | 76.29 | 81.58 | 78.85 | 62.05 | 68.03 | 64.9 | 86.84 | 96.59 | 91.46 | |
| STaR-DROModel=Llama-3.2-1B-Instruct2026.04 | 76.22 | 79.41 | 77.78 | 62.26 | 66.79 | 64.45 | 86.87 | 95.94 | 91.18 | |
| SFTModel=Llama-3.1-8B-Instruct2026.04 | 75.96 | 81.45 | 78.61 | 63.58 | 69.75 | 66.52 | 86.86 | 96.52 | 91.43 | |
| SFTModel=Llama-3.2-1B-Instruct2026.04 | 75.65 | 80.2 | 77.86 | 61.41 | 65.97 | 63.21 | 86.91 | 96.01 | 91.23 | |
| Standard DROModel=Llama-3.2-3B-Instruct2026.04 | 75.33 | 78.2 | 76.74 | 62.2 | 64.96 | 63.55 | 89.24 | 94.67 | 91.87 | |
| Standard DROModel=Llama-3.1-8B-Instruct2026.04 | 74.96 | 79.03 | 76.94 | 61.94 | 66.87 | 64.31 | 87.93 | 95.87 | 91.73 | |
| Standard DROModel=Llama-3.2-1B-Instruct2026.04 | 74.12 | 77.78 | 75.91 | 59.82 | 64.06 | 61.86 | 87.71 | 95.94 | 91.64 |