List your company

Severity Classification on Smart Contract Audit Dataset

61.97PrecisionOurs (rsLoRA + Voting)
15.523627.581839.6451.6982Jun 2, 2026

Evaluation results

MethodLinks
Ours (rsLoRA + Voting)Evaluation Protocol=Framework, Components=rsLoRA + Voting2026.0661.9757.4558.7764.58
LoRA (with voting)Evaluation Protocol=Framework Ablation, Configuration=with voting2026.0659.6152.850.8163.19
CodeLlama-34BEvaluation Protocol=Zero-Shot (ZS)2026.0654.7247.7637.7536.81
CodeLlama-13BEvaluation Protocol=Zero-Shot (ZS)2026.0652.7836.3919.0526.39
CodeGemma-7BEvaluation Protocol=Fine-Tuned (FT)2026.0640.7847.3843.3261.11
Qwen2.5-14BEvaluation Protocol=Fine-Tuned (FT)2026.0639.2347.1142.659.72
CodeLlama-34BEvaluation Protocol=Fine-Tuned (FT)2026.0639.0340.6436.958.33
Qwen2.5-32BEvaluation Protocol=Fine-Tuned (FT)2026.0639.0146.1341.9459.03
Codestral-22BEvaluation Protocol=Fine-Tuned (FT)2026.0638.847.8242.7959.03
DeepSeek-7BEvaluation Protocol=Fine-Tuned (FT)2026.0636.7837.733.3156.25
CodeLlama-13BEvaluation Protocol=Fine-Tuned (FT)2026.0635.3536.7231.9755.56
LoRA (w/o voting)Evaluation Protocol=Framework Ablation, Configuration=w/o voting2026.0635.2935.5929.8155.56
rsLoRA (w/o voting)Evaluation Protocol=Framework Ablation, Configuration=w/o voting2026.0633.7139.1235.2154.86
Qwen2.5-32BEvaluation Protocol=Zero-Shot (ZS)2026.0631.9845.9634.7846.53
Qwen2.5-14BEvaluation Protocol=Zero-Shot (ZS)2026.0625.2138.3125.5834.72
DeepSeek-7BEvaluation Protocol=Zero-Shot (ZS)2026.0623.6530.7124.5433.33
Codestral-22BEvaluation Protocol=Zero-Shot (ZS)2026.0618.5233.3323.8155.56
DeepSeek-33BEvaluation Protocol=Zero-Shot (ZS)2026.0618.5233.3323.8155.56
DeepSeek-33BEvaluation Protocol=Fine-Tuned (FT)2026.0618.5233.3323.8155.56
CodeGemma-7BEvaluation Protocol=Zero-Shot (ZS)2026.0617.3132.2114.0123.61