List your company
ResearchFormerly WizWand

Question Answering on AVG.

47.5EMEXIT
14.386422.983231.5840.1768Dec 17, 2024Jan 30, 2025Mar 15, 2025Apr 28, 2025Jun 11, 2025Jul 25, 2025Sep 7, 2025
Updated 5mo ago

Evaluation results

MethodLinks
EXITBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-20, Compressor Type=Ext.2024.1247.556.9
Original DocsBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-20, Compressor Type=-2024.124756.9
EXITBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-5, Compressor Type=Ext.2024.1245.755.1
LongLLMLinguaBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-20, Compressor Type=Ext.2024.1245.254.6
DecoupleSearchBackbone=Qwen-2.5-14B-Instruct2025.0944.6342.5
Original DocsBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-5, Compressor Type=-2024.1243.853.1
CompActBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-5, Compressor Type=Abs.2024.1243.753
LongLLMLinguaBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-5, Compressor Type=Ext.2024.1243.752.8
RefinerBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-5, Compressor Type=Abs.2024.1243.152.4
RefinerBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-20, Compressor Type=Abs.2024.1241.650.3
RECOMP-ExtrBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-5, Compressor Type=Ext.2024.1241.449.7
RECOMP-AbstBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-20, Compressor Type=Abs.2024.1241.450.8
CompActBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-20, Compressor Type=Abs.2024.1240.849.2
GreedyAgentBackbone=Qwen-2.5-14B-Instruct2025.0940.3639.63
EXITBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-20, Compressor Type=Ext.2024.1240.349.8
RECOMP-ExtrBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-20, Compressor Type=Ext.2024.1240.148.2
RECOMP-AbstBackbone=Llama-3.1-70B-Instruct, Top-k Documents=Top-5, Compressor Type=Abs.2024.124049.3
DecoupleSearchBackbone=Qwen-2.5-7B-Instruct2025.0939.9338.79
Original DocsBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-20, Compressor Type=-2024.1239.749.4
LongLLMLinguaBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-20, Compressor Type=Ext.2024.1238.547.5
RAgentBackbone=Qwen-2.5-14B-Instruct2025.0938.2338.86
EXITBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-5, Compressor Type=Ext.2024.1238.147.4
Original DocsBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-5, Compressor Type=-2024.1237.547
Search-o1Backbone=Qwen-2.5-14B-Instruct2025.0937.4639.49
CompActBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-5, Compressor Type=Abs.2024.1237.346.8
RefinerBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-5, Compressor Type=Abs.2024.1237.146.5
CompActBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-20, Compressor Type=Abs.2024.1236.946.3
RECOMP-AbstBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-5, Compressor Type=Abs.2024.1236.245.3
RECOMP-AbstBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-20, Compressor Type=Abs.2024.1235.944.6
GreedyAgentBackbone=Qwen-2.5-7B-Instruct2025.0935.8735.34
RefinerBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-20, Compressor Type=Abs.2024.1235.644.7
LongLLMLinguaBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-5, Compressor Type=Ext.2024.1235.544.1
RECOMP-ExtrBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-5, Compressor Type=Ext.2024.1235.443.7
RECOMP-ExtrBackbone=Llama-3.1-8B-Instruct, Top-k Documents=Top-20, Compressor Type=Ext.2024.123442.1
Search-o1Backbone=Qwen-2.5-7B-Instruct2025.0931.3733.4
CoTBackbone=Qwen-2.5-14B-Instruct2025.0930.8934.04
Gen-RetrieveBackbone=Qwen-2.5-14B-Instruct2025.0929.8727.75
RAgentBackbone=Qwen-2.5-7B-Instruct2025.0929.8532.02
Jud-RetrieveBackbone=Qwen-2.5-14B-Instruct2025.0929.7527.29
StandardBackbone=Qwen-2.5-14B-Instruct2025.0929.6327.36
StandardBackbone=Qwen-2.5-7B-Instruct2025.0925.2727.42
Gen-RetrieveBackbone=Qwen-2.5-7B-Instruct2025.0925.1927.02
Judge-RetrieveBackbone=Qwen-2.5-7B-Instruct2025.0925.0727.54
DirectBackbone=Qwen-2.5-14B-Instruct2025.0924.1426.91
CoTBackbone=Qwen-2.5-7B-Instruct2025.0922.8126.32
DirectBackbone=Qwen-2.5-7B-Instruct2025.0921.9924.7
IterativeBackbone=Qwen-2.5-7B-Instruct2025.0917.1518.93
IterativeBackbone=Qwen-2.5-14B-Instruct2025.0915.6616.63