Requirements Engineering on EDA requirements engineering (Noisy context)
69.76F1 Score (Ref)Qwen2.5-7B-Instruct + LoRA (w/ all)
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5-7B-Instruct + LoRA (w/ all)Model=Qwen2.5-7B-Instruct, LoRA Adaptation=true, Context Strategy=w/ all2026.03 | 69.76 | 67.76 | 71.88 | 27.58 | 75.81 | 36.39 | 33.67 | 40.33 | |
| Qwen2.5-7B-Instruct + LoRA (w/o context)Model=Qwen2.5-7B-Instruct, LoRA Adaptation=true, Context Strategy=w/o context2026.03 | 68.87 | 68.1 | 69.65 | 28.08 | 75.79 | 37.05 | 35.08 | 38.59 | |
| Qwen2.5-7B-Instruct + LoRA (RAFT)Model=Qwen2.5-7B-Instruct, LoRA Adaptation=true, Context Strategy=RAFT (w/ noisy + irr)2026.03 | 68.57 | 68.74 | 68.4 | 28.48 | 78.26 | 36.39 | 36.33 | 38.03 | |
| Qwen2.5-7B-Instruct + LoRA (PA-RAG)Model=Qwen2.5-7B-Instruct, LoRA Adaptation=true, Context Strategy=PA-RAG (w/ rel. + irr)2026.03 | 68.12 | 67.47 | 68.78 | 27.1 | 74.96 | 36.16 | 34.82 | 42.23 | |
| Qwen2.5-72B-InstructModel=Qwen2.5-72B-Instruct, LoRA Adaptation=false, Context Strategy=N/A2026.03 | 64.78 | 51.15 | 88.33 | 24.21 | 51.09 | 47.38 | 30.24 | 30.93 | |
| Qwen2.5-7B-InstructModel=Qwen2.5-7B-Instruct, LoRA Adaptation=false, Context Strategy=N/A2026.03 | 62.05 | 53.25 | 74.33 | 21.87 | 57 | 38.4 | 33.49 | 38.34 | |
| Qwen2.5-7B-Instruct + LoRA (w/ relevant)Model=Qwen2.5-7B-Instruct, LoRA Adaptation=true, Context Strategy=w/ relevant2026.03 | 61.86 | 60.84 | 62.92 | 27.98 | 74.65 | 37.48 | 40.21 | 30.87 |