List your company

Question Answering on LooGLE Long Dependency QA

0.0942BLEU-1VIST2-8B
-0.0029360.0222820.04750.072718Jan 15, 2026

Evaluation results

MethodLinks
VIST2-8BContext=8k×42026.010.09420.01780.40120.14220.38120.11450.85340.5645
VIST2-4BContext=8k×42026.010.09050.01550.38650.1350.3710.10820.8460.5412
GPT4-8kContext=8k2026.010.08940.01010.23450.06570.21690.10180.85360.4212
GPT4-32kContext=32k2026.010.08550.0140.25590.06360.24040.11130.80160.5409
VIST2-0.6BContext=8k×42026.010.08120.00950.3510.1120.33450.09850.82150.483
LlamaIndexContext=-2026.010.07760.01240.23620.0710.2230.10470.83870.3763
GPT3.5-turbo-16kContext=16k2026.010.06920.01810.25020.06680.23630.1040.83790.4504
LongLLaMa-3B-InstructContext=256k2026.010.05640.00490.1730.03760.16290.06530.84260.2164
ChatGLM2-6BContext=32k2026.010.05550.00110.09410.01930.08690.04390.85780.115
RWKV-4-14B-ravenContext=8k2026.010.03880.00220.20390.0320.1920.06410.81460.1432
Claude3-opusContext=200k2026.010.03280.00430.37950.13460.36560.09440.79580.2071
LLaMA2-7B-32K-InstructContext=32k2026.010.000800.040700.04070.01060.66540.0285