Laboratory-language grounding on LabGuard-Bench (random 80/20 split)
91.5Type AccuracyQwen3-8B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Qwen3-8BSetting=LoRA2026.06 | 91.5 | 97.3 | 93.6 | 86.8 | 72.9 | 100 | 100 | |
| LabGuard-Hybrid2026.06 | 91.4 | 97.1 | 93.5 | 86.6 | 73 | 100 | 100 | |
| Qwen2.5-72BSetting=0-shot2026.06 | 77.4 | 89 | 69.8 | 29.1 | 12 | 98.2 | 98.2 | |
| DeepSeek-V3.1Setting=0-shot2026.06 | 76.8 | 88.5 | 68.9 | 27.3 | 11.5 | 97.6 | 97.6 | |
| Qwen3-32BSetting=0-shot2026.06 | 74.4 | 87.1 | 66.8 | 24.7 | 9.8 | 96.3 | 96.3 | |
| Regex BL2026.06 | 70.7 | 95.9 | 48.1 | 19.9 | 0.8 | 100 | 100 | |
| Qwen-7BSetting=0-shot2026.06 | 68.3 | 85.4 | 63.6 | 20.3 | 7.3 | 95.1 | 95.1 | |
| SciBERT2026.06 | 64 | 82.1 | 55.8 | 12.6 | 5.1 | 88.4 | 88.4 | |
| Heuristic Mapper2026.06 | 19.5 | 95.9 | 17.3 | 0.5 | 0.3 | 46.3 | 46.3 |