Structured Information Extraction on EPPC
87.57Code F1EPPC-OASIS (weight avg.)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| EPPC-OASIS (weight avg.)Model=Llama-3.3-70B-Instruct, Decoding Strategy=greedy2026.05 | 87.57 | 78.79 | 81.71 | 75.33 | 60.97 | |
| EPPC-OASIS (weight avg.)Model=Qwen2.5-32B-Instruct, Decoding Strategy=greedy2026.05 | 87.29 | 80.34 | 85.59 | 77.13 | 63.83 | |
| SFTModel=Qwen2.5-32B-Instruct, Decoding Strategy=greedy2026.05 | 86.95 | 78.71 | 84.09 | 75.74 | 61.71 | |
| EPPC-OASIS (weight avg.)Model=Mistral-Small-24B-Instruct, Decoding Strategy=greedy2026.05 | 86.85 | 79.3 | 84.19 | 75.89 | 62.75 | |
| EPPC-OASIS (weight avg.)Model=Llama-3.1-8B-Instruct, Decoding Strategy=greedy2026.05 | 86.76 | 78.65 | 84.11 | 75.56 | 62.99 | |
| EPPC-OASISModel=Qwen2.5-32B-Instruct, Decoding Strategy=greedy2026.05 | 86.63 | 78.62 | 84.32 | 75.43 | 61.49 | |
| EPPC-OASISModel=Llama-3.1-8B-Instruct, Decoding Strategy=greedy2026.05 | 86.07 | 78 | 82.85 | 75.51 | 60.57 | |
| EPPC-OASISModel=Llama-3.3-70B-Instruct, Decoding Strategy=greedy2026.05 | 86.02 | 77.87 | 82.85 | 74.91 | 61.22 | |
| SFTModel=Mistral-Small-24B-Instruct, Decoding Strategy=greedy2026.05 | 85.92 | 77.82 | 83.8 | 74.84 | 60.86 | |
| EPPC-OASIS (weight avg.)Model=Llama-3.2-3B-Instruct, Decoding Strategy=greedy2026.05 | 85.89 | 78.38 | 82.68 | 75.24 | 61.79 | |
| EPPC-OASISModel=Mistral-Small-24B-Instruct, Decoding Strategy=greedy2026.05 | 85.82 | 78.39 | 84.45 | 75.26 | 60.89 | |
| EPPC-OASIS (weight avg.)Model=Qwen2.5-3B-Instruct, Decoding Strategy=greedy2026.05 | 85.76 | 79.01 | 82.33 | 75.17 | 59.35 | |
| SFTModel=Qwen2.5-7B-Instruct, Decoding Strategy=greedy2026.05 | 85.59 | 77.76 | 82.95 | 74.36 | 59.51 | |
| EPPC-OASIS (weight avg.)Model=Qwen2.5-7B-Instruct, Decoding Strategy=greedy2026.05 | 85.37 | 78.79 | 83.52 | 74.57 | 60.61 | |
| SFTModel=Qwen2.5-3B-Instruct, Decoding Strategy=greedy2026.05 | 85.28 | 77.74 | 82.13 | 74.29 | 58.84 | |
| EPPC-OASIS (weight avg.)Model=DeepSeek-R1-Distill-Llama-70B, Decoding Strategy=greedy2026.05 | 85.28 | 78.62 | 83.01 | 75.31 | 61.28 | |
| SFTModel=Llama-3.3-70B-Instruct, Decoding Strategy=greedy2026.05 | 85.13 | 78.33 | 82.73 | 74.64 | 60.07 | |
| EPPC-OASISModel=Qwen2.5-7B-Instruct, Decoding Strategy=greedy2026.05 | 85 | 77.68 | 83.18 | 74.07 | 59.55 | |
| SFTModel=Llama-3.2-3B-Instruct, Decoding Strategy=greedy2026.05 | 84.98 | 77.26 | 82.45 | 74.05 | 58.95 | |
| SFTModel=DeepSeek-R1-Distill-Llama-70B, Decoding Strategy=greedy2026.05 | 84.98 | 78.03 | 81.94 | 74.64 | 60.45 | |
| EPPC-OASISModel=Qwen2.5-3B-Instruct, Decoding Strategy=greedy2026.05 | 84.95 | 77.51 | 82.01 | 73.8 | 58.88 | |
| EPPC-OASIS (weight avg.)Model=Llama-3.2-1B-Instruct, Decoding Strategy=greedy2026.05 | 84.8 | 77.07 | 83.54 | 73.71 | 59.88 | |
| SFTModel=Llama-3.1-8B-Instruct, Decoding Strategy=greedy2026.05 | 84.66 | 77.83 | 83.28 | 74.93 | 60.36 | |
| EPPC-OASISModel=DeepSeek-R1-Distill-Llama-70B, Decoding Strategy=greedy2026.05 | 84.04 | 75.8 | 81.09 | 72.38 | 58.66 | |
| EPPC-OASISModel=Llama-3.2-3B-Instruct, Decoding Strategy=greedy2026.05 | 84.02 | 76.14 | 81.49 | 74.72 | 59.24 | |
| EPPC-OASISModel=Llama-3.2-1B-Instruct, Decoding Strategy=greedy2026.05 | 83.87 | 75.22 | 80.29 | 72.15 | 56.35 | |
| SFTModel=Llama-3.2-1B-Instruct, Decoding Strategy=greedy2026.05 | 83.25 | 74.42 | 81.04 | 70.97 | 53.99 |