Note Generation on XCHECK 1.0 (test)
0.1526R-LGPT5-mini
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT5-mini# Params=-, Strategy=Web search2026.03 | 0.1526 | 0.2892 | 0.7112 | 0.8997 | 0.4411 | |
| NVILA# Params=15B, Strategy=ACCNOTE2026.03 | 0.1507 | 0.3343 | 0.7256 | 0.9003 | 0.4523 | |
| Qwen2.5-VL# Params=7B, Strategy=ACCNOTE2026.03 | 0.1491 | 0.321 | 0.7307 | 0.9054 | 0.451 | |
| NVILA# Params=8B, Strategy=ACCNOTE2026.03 | 0.1471 | 0.3707 | 0.7176 | 0.8712 | 0.4507 | |
| LLaVA-NeXT# Params=32B, Strategy=ACCNOTE2026.03 | 0.1466 | 0.2905 | 0.6813 | 0.9023 | 0.4335 | |
| Qwen2.5-VL# Params=32B, Strategy=ACCNOTE2026.03 | 0.1405 | 0.2788 | 0.7524 | 0.9219 | 0.4468 | |
| InternVL3# Params=14B, Strategy=ACCNOTE2026.03 | 0.1402 | 0.2987 | 0.736 | 0.9203 | 0.4471 | |
| Qwen2.5-VL# Params=7B, Strategy=Naive RAG2026.03 | 0.1389 | 0.0052 | 0.7195 | 0.9094 | 0.3824 | |
| NVILA# Params=15B, Strategy=Naive RAG2026.03 | 0.1359 | 0.0048 | 0.7059 | 0.8793 | 0.3723 | |
| NVILA# Params=8B, Strategy=Naive RAG2026.03 | 0.1339 | 0.0046 | 0.7144 | 0.8575 | 0.3688 | |
| InternVL3# Params=14B, Strategy=Naive RAG2026.03 | 0.1334 | 0.0048 | 0.7165 | 0.8915 | 0.3759 | |
| LLaVA-NeXT# Params=32B, Strategy=Naive RAG2026.03 | 0.1307 | 0.0046 | 0.668 | 0.9003 | 0.3668 | |
| Qwen2.5-VL# Params=7B, Strategy=Closed-book2026.03 | 0.1286 | 0.0046 | 0.7061 | 0.9071 | 0.375 | |
| Qwen2.5-VL# Params=32B, Strategy=Naive RAG2026.03 | 0.1275 | 0.0046 | 0.7522 | 0.9139 | 0.3851 | |
| InternVL3# Params=8B, Strategy=ACCNOTE2026.03 | 0.1272 | 0.1983 | 0.7041 | 0.9156 | 0.4145 | |
| InternVL3# Params=8B, Strategy=Naive RAG2026.03 | 0.127 | 0.0051 | 0.6996 | 0.8853 | 0.3688 | |
| NVILA# Params=8B, Strategy=Closed-book2026.03 | 0.1253 | 0.0047 | 0.692 | 0.8573 | 0.3609 | |
| LLaVA-NeXT# Params=8B, Strategy=ACCNOTE2026.03 | 0.1241 | 0.2197 | 0.6283 | 0.9027 | 0.3998 | |
| NVILA# Params=15B, Strategy=Closed-book2026.03 | 0.124 | 0.0046 | 0.6871 | 0.8805 | 0.3641 | |
| GPT5-mini# Params=-, Strategy=Closed-book2026.03 | 0.1234 | 0.0046 | 0.7117 | 0.8988 | 0.3724 | |
| LLaVA-NeXT# Params=32B, Strategy=Closed-book2026.03 | 0.1218 | 0.0046 | 0.6672 | 0.8984 | 0.3628 | |
| InternVL3# Params=14B, Strategy=Closed-book2026.03 | 0.1208 | 0.0046 | 0.6921 | 0.8966 | 0.367 | |
| Qwen2.5-VL# Params=32B, Strategy=Closed-book2026.03 | 0.1205 | 0.0046 | 0.7195 | 0.9156 | 0.3761 | |
| InternVL3# Params=8B, Strategy=Closed-book2026.03 | 0.1175 | 0.0047 | 0.6667 | 0.885 | 0.3583 | |
| LLaVA-NeXT# Params=8B, Strategy=Naive RAG2026.03 | 0.1164 | 0.0047 | 0.6172 | 0.8829 | 0.3475 | |
| LLaVA-NeXT# Params=8B, Strategy=Closed-book2026.03 | 0.1104 | 0.0046 | 0.6106 | 0.8893 | 0.3451 | |
| SNIFFER# Params=∼26B, Strategy=Closed-book2026.03 | 0.0802 | 0.0047 | 0.3125 | 0.6759 | 0.2307 | |
| SNIFFER# Params=∼26B, Strategy=Web search2026.03 | 0.08 | 0.0065 | 0.3118 | 0.7082 | 0.2373 |