Data Extraction on Dolly D2
49.2Mean Match RatioSFT
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SFTBackbone=Qwen2.5-32B2025.05 | 49.2 | 81.3 | 43.8 | 76.6 | 81.3 | 79.5 | |
| SFTBackbone=Llama3.1-8B2025.05 | 43.3 | 81.5 | 37 | 78.1 | 78.2 | 74 | |
| GRPOBackbone=Llama3.1-8B2025.05 | 38.5 | 73.2 | 31.7 | 69.1 | 82.6 | 81 | |
| GRPOBackbone=Qwen2.5-7B2025.05 | 33.2 | 68.7 | 28.2 | 63.4 | 82.7 | 82 | |
| SFTBackbone=Qwen2.5-7B2025.05 | 29.8 | 63.5 | 24.5 | 58.1 | 79.4 | 79 | |
| SFTBackbone=Llama3.2-3B2025.05 | 25.3 | 49.4 | 15.9 | 42.5 | 78.6 | 73 | |
| GRPOBackbone=Llama3.2-3B2025.05 | 25.1 | 54.2 | 15.8 | 46 | 78.4 | 73.5 | |
| RawBackbone=Qwen2.5-32B2025.05 | 18.7 | 33 | 6.5 | 19.4 | 64.6 | 60 | |
| RawBackbone=Llama3.1-8B2025.05 | 14.4 | 29.8 | 6.5 | 20 | 66.7 | 50 | |
| RawBackbone=Qwen2.5-7B2025.05 | 13.4 | 27.4 | 5 | 16.2 | 68.8 | 55 | |
| RawBackbone=Llama3.2-3B2025.05 | 11.6 | 23.5 | 3.9 | 13.5 | 63.6 | 60.5 |