Annotation Accuracy on DeepSeek-R1 Experiment 1
100F1 Score (Ga)Template-based
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Template-basedn=3, Backbone=DeepSeek-R12026.04 | 100 | 0 | 0 | |
| Template-basedn=4, Backbone=DeepSeek-R12026.04 | 100 | 0 | 0 | |
| Template-basedn=5, Backbone=DeepSeek-R12026.04 | 100 | 0 | 0 | |
| Template-basedn=6, Backbone=DeepSeek-R12026.04 | 100 | 0 | 0 | |
| Template-basedn=7, Backbone=DeepSeek-R12026.04 | 100 | 0 | 0 | |
| Template-basedn=8, Backbone=DeepSeek-R12026.04 | 100 | 0 | 0 | |
| Template-basedn=9, Backbone=DeepSeek-R12026.04 | 100 | 0 | 0 | |
| Template-basedn=10, Backbone=DeepSeek-R12026.04 | 100 | 0 | 0 | |
| iTAGn=3, Backbone=DeepSeek-R12026.04 | 97 | 0.5 | 0.3 | |
| iTAGn=4, Backbone=DeepSeek-R12026.04 | 96 | 0.7 | 0.4 | |
| iTAGn=5, Backbone=DeepSeek-R12026.04 | 95 | 0.9 | 0.5 | |
| iTAGn=6, Backbone=DeepSeek-R12026.04 | 94 | 1.1 | 0.6 | |
| iTAGn=7, Backbone=DeepSeek-R12026.04 | 93 | 1.3 | 0.7 | |
| iTAGn=8, Backbone=DeepSeek-R12026.04 | 93 | 1.6 | 0.8 | |
| iTAGn=9, Backbone=DeepSeek-R12026.04 | 92 | 1.8 | 0.9 | |
| iTAGn=10, Backbone=DeepSeek-R12026.04 | 91 | 2.1 | 1 | |
| LLM+IDn=3, Backbone=DeepSeek-R12026.04 | 77 | 3 | 2.6 | |
| LLM+CAn=3, Backbone=DeepSeek-R12026.04 | 75 | 3.2 | 2.8 | |
| LLM+IDn=4, Backbone=DeepSeek-R12026.04 | 73 | 4.2 | 3.8 | |
| LLM+CAn=4, Backbone=DeepSeek-R12026.04 | 71 | 4.4 | 4 | |
| LLM-dependentn=3, Backbone=DeepSeek-R12026.04 | 70 | 3.8 | 3.2 | |
| LLM+IDn=5, Backbone=DeepSeek-R12026.04 | 69 | 5.6 | 5.2 | |
| LLM+CAn=5, Backbone=DeepSeek-R12026.04 | 67 | 5.9 | 5.4 | |
| LLM-dependentn=4, Backbone=DeepSeek-R12026.04 | 66 | 5.1 | 4.5 | |
| LLM+IDn=6, Backbone=DeepSeek-R12026.04 | 65 | 7 | 6.5 | |
| LLM+CAn=6, Backbone=DeepSeek-R12026.04 | 63 | 7.3 | 6.8 | |
| LLM-dependentn=5, Backbone=DeepSeek-R12026.04 | 62 | 6.5 | 6 | |
| LLM+IDn=7, Backbone=DeepSeek-R12026.04 | 62 | 8.5 | 7.9 | |
| LLM+CAn=7, Backbone=DeepSeek-R12026.04 | 60 | 8.9 | 8.3 | |
| LLM+IDn=8, Backbone=DeepSeek-R12026.04 | 59 | 10 | 9.4 | |
| LLM-dependentn=6, Backbone=DeepSeek-R12026.04 | 58 | 8 | 7.4 | |
| LLM+CAn=8, Backbone=DeepSeek-R12026.04 | 57 | 10.4 | 9.8 | |
| LLM+IDn=9, Backbone=DeepSeek-R12026.04 | 56 | 11.4 | 10.9 | |
| LLM-dependentn=7, Backbone=DeepSeek-R12026.04 | 55 | 9.6 | 9 | |
| LLM+CAn=9, Backbone=DeepSeek-R12026.04 | 54 | 11.9 | 11.3 | |
| LLM+IDn=10, Backbone=DeepSeek-R12026.04 | 53 | 13 | 12.4 | |
| LLM-dependentn=8, Backbone=DeepSeek-R12026.04 | 52 | 11.1 | 10.6 | |
| LLM+CAn=10, Backbone=DeepSeek-R12026.04 | 51 | 13.5 | 12.9 | |
| LLM-dependentn=9, Backbone=DeepSeek-R12026.04 | 49 | 12.7 | 12.1 | |
| LLM-dependentn=10, Backbone=DeepSeek-R12026.04 | 46 | 14.3 | 13.7 |