List your company
ResearchFormerly WizWand

Annotation Accuracy on DeepSeek-R1 Experiment 1

100F1 Score (Ga)Template-based
43.8458.427387.58Apr 8, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Template-basedn=3, Backbone=DeepSeek-R12026.0410000
Template-basedn=4, Backbone=DeepSeek-R12026.0410000
Template-basedn=5, Backbone=DeepSeek-R12026.0410000
Template-basedn=6, Backbone=DeepSeek-R12026.0410000
Template-basedn=7, Backbone=DeepSeek-R12026.0410000
Template-basedn=8, Backbone=DeepSeek-R12026.0410000
Template-basedn=9, Backbone=DeepSeek-R12026.0410000
Template-basedn=10, Backbone=DeepSeek-R12026.0410000
iTAGn=3, Backbone=DeepSeek-R12026.04970.50.3
iTAGn=4, Backbone=DeepSeek-R12026.04960.70.4
iTAGn=5, Backbone=DeepSeek-R12026.04950.90.5
iTAGn=6, Backbone=DeepSeek-R12026.04941.10.6
iTAGn=7, Backbone=DeepSeek-R12026.04931.30.7
iTAGn=8, Backbone=DeepSeek-R12026.04931.60.8
iTAGn=9, Backbone=DeepSeek-R12026.04921.80.9
iTAGn=10, Backbone=DeepSeek-R12026.04912.11
LLM+IDn=3, Backbone=DeepSeek-R12026.047732.6
LLM+CAn=3, Backbone=DeepSeek-R12026.04753.22.8
LLM+IDn=4, Backbone=DeepSeek-R12026.04734.23.8
LLM+CAn=4, Backbone=DeepSeek-R12026.04714.44
LLM-dependentn=3, Backbone=DeepSeek-R12026.04703.83.2
LLM+IDn=5, Backbone=DeepSeek-R12026.04695.65.2
LLM+CAn=5, Backbone=DeepSeek-R12026.04675.95.4
LLM-dependentn=4, Backbone=DeepSeek-R12026.04665.14.5
LLM+IDn=6, Backbone=DeepSeek-R12026.046576.5
LLM+CAn=6, Backbone=DeepSeek-R12026.04637.36.8
LLM-dependentn=5, Backbone=DeepSeek-R12026.04626.56
LLM+IDn=7, Backbone=DeepSeek-R12026.04628.57.9
LLM+CAn=7, Backbone=DeepSeek-R12026.04608.98.3
LLM+IDn=8, Backbone=DeepSeek-R12026.0459109.4
LLM-dependentn=6, Backbone=DeepSeek-R12026.045887.4
LLM+CAn=8, Backbone=DeepSeek-R12026.045710.49.8
LLM+IDn=9, Backbone=DeepSeek-R12026.045611.410.9
LLM-dependentn=7, Backbone=DeepSeek-R12026.04559.69
LLM+CAn=9, Backbone=DeepSeek-R12026.045411.911.3
LLM+IDn=10, Backbone=DeepSeek-R12026.04531312.4
LLM-dependentn=8, Backbone=DeepSeek-R12026.045211.110.6
LLM+CAn=10, Backbone=DeepSeek-R12026.045113.512.9
LLM-dependentn=9, Backbone=DeepSeek-R12026.044912.712.1
LLM-dependentn=10, Backbone=DeepSeek-R12026.044614.313.7