POI Attribute Acquisition on DuIVRS logs (Deffect) 1.0 (test)
81.62Completion RateDuIVRS-2
Evaluation results
| Method | Links | |
|---|---|---|
| DuIVRS-2LLM-S=ERNIE-Bot-tiny, LLM-L=ERNIE-Bot-turbo, Black-box LLM=ERNIE 4.02026.05 | 81.62 | |
| HybridLLMsLLM-S=Qwen2.5-1.5B, LLM-L=Qwen2.5-7B, Black-box LLM=GPT-4o2026.05 | 81.37 | |
| LLM-DM2026.05 | 76.68 | |
| w/o-DA2026.05 | 76.52 | |
| DeepSeek-V32026.05 | 73.18 | |
| DuIVRS-12026.05 | 72.2 | |
| GPT-4o2026.05 | 72.11 | |
| Direct-SFT2026.05 | 69.18 | |
| w/o-CoT2026.05 | 44.25 |