List your company
ResearchFormerly WizWand

Question Answering on MultiFieldQA en

24.67EMBRIEF-PRO-AUTO
6.636411.31821620.6818Oct 15, 2025
Updated 6mo ago

Evaluation results

MethodLinks
BRIEF-PRO-AUTOBackbone LM=Llama-3.1-8B-Instruct, Category=Abstractive2025.1024.6754.2111
BRIEF-PRO-HIGHBackbone LM=Llama-3.1-8B-Instruct, Category=Abstractive2025.102452.4329
BRIEF-PRO-MEDIUMBackbone LM=Llama-3.1-8B-Instruct, Category=Abstractive2025.102452.2316
BRIEF-PRO-LOWBackbone LM=Llama-3.1-8B-Instruct, Category=Abstractive2025.102453.8810
ProLong-8BCategory=Long-context LLMs2025.102251.441
FILM-7BCategory=Long-context LLMs2025.102254.341
Non-compressionBackbone LM=Llama-3.1-8B-Instruct, Category=Non-compression2025.1021.3352.771
Non-compressionBackbone LM=Llama-3.1-70B-Instruct, Category=Non-compression2025.1021.3354.381
BRIEF-PRO-HIGHBackbone LM=Llama-3.1-70B-Instruct, Category=Abstractive2025.1021.3350.729
BRIEF-PRO-AUTOBackbone LM=Llama-3.1-70B-Instruct, Category=Abstractive2025.1020.6751.1611
BRIEF-PRO-MEDIUMBackbone LM=Llama-3.1-70B-Instruct, Category=Abstractive2025.1020.6751.9316
BRIEF-PRO-LOWBackbone LM=Llama-3.1-70B-Instruct, Category=Abstractive2025.1020.6750.6310
RECOMP (Extractive)Backbone LM=Llama-3.1-70B-Instruct, Category=Extractive2025.101846.4316
BRIEF-PRO-HIGHBackbone LM=GPT-4.1-nano, Category=Abstractive2025.101848.5329
RECOMP (Extractive)Backbone LM=Llama-3.1-8B-Instruct, Category=Extractive2025.1017.3343.8216
LongLLMLinguaBackbone LM=Llama-3.1-8B-Instruct, Category=Abstractive2025.1017.3344.624
Rerank Top-3Backbone LM=Llama-3.1-70B-Instruct, Category=Extractive2025.1017.3345.13
BRIEF-PRO-LOWBackbone LM=GPT-4.1-nano, Category=Abstractive2025.1017.3349.7510
LongLLMLinguaBackbone LM=Llama-3.1-70B-Instruct, Category=Abstractive2025.1016.6745.874
Non-compressionBackbone LM=GPT-4.1-nano, Category=Non-compression2025.1016.6750.091
BRIEF-PRO-AUTOBackbone LM=GPT-4.1-nano, Category=Abstractive2025.1016.6748.1711
BRIEF-PRO-MEDIUMBackbone LM=GPT-4.1-nano, Category=Abstractive2025.1016.6749.7916
Rerank Top-3Backbone LM=Llama-3.1-8B-Instruct, Category=Extractive2025.1016.543.13
Llama-3.2-3B-InstructBackbone LM=Llama-3.1-8B-Instruct, Category=Abstractive2025.1014.6742.316
GPT-4.1-nanoBackbone LM=Llama-3.1-8B-Instruct, Category=Abstractive2025.1014.6741.9529
LongLLMLinguaBackbone LM=GPT-4.1-nano, Category=Abstractive2025.101444.884
GPT-4.1-nanoBackbone LM=Llama-3.1-70B-Instruct, Category=Abstractive2025.1013.3341.4429
Rerank Top-3Backbone LM=GPT-4.1-nano, Category=Extractive2025.1013.3342.673
Llama-3.2-3B-InstructBackbone LM=Llama-3.1-70B-Instruct, Category=Abstractive2025.1012.839.3116
RECOMP (Extractive)Backbone LM=GPT-4.1-nano, Category=Extractive2025.1012.6743.7216
Llama-3.2-3B-InstructBackbone LM=GPT-4.1-nano, Category=Abstractive2025.1012.6741.5516
GPT-4.1-nanoBackbone LM=GPT-4.1-nano, Category=Abstractive2025.1012.6741.0429
RECOMP (Abstractive)Backbone LM=Llama-3.1-70B-Instruct, Category=Abstractive2025.1011.3333.7812
EXITBackbone LM=Llama-3.1-8B-Instruct, Category=Extractive2025.1010.6725.3314
EXITBackbone LM=Llama-3.1-70B-Instruct, Category=Extractive2025.1010.6725.7514
EXITBackbone LM=GPT-4.1-nano, Category=Extractive2025.109.3327.1214
RECOMP (Abstractive)Backbone LM=Llama-3.1-8B-Instruct, Category=Abstractive2025.10830.1412
RECOMP (Abstractive)Backbone LM=GPT-4.1-nano, Category=Abstractive2025.107.3328.8312