List your company
ResearchFormerly WizWand

Question Answering on 8-concept

86.2Concept Accuracy (Con)Baseline
-0.84821.75144.3566.949Jun 2, 2026
Updated 5mo ago

Evaluation results

MethodLinks
BaselineBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=MLP-based2026.0686.287.2
NoiseBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=Embedding-only2026.0678.586.5
BaselineBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=MLP-based2026.0674.578.5
BaselineBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=MLP-based2026.0674.286
MeanBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=Embedding-only2026.0669.584.2
BaselineBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=MLP-based2026.066280.8
MeanBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=Embedding-only2026.0661.583.5
PISCESBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=MLP-based2026.0660.578.8
NoiseBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=Embedding-only2026.0659.783.5
NoiseBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=Embedding-only2026.0656.275.8
PISCESBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=MLP-based2026.0651.582
EMBERBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=Embedding-only2026.0650.581.2
MeanBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=Embedding-only2026.0650.573.8
SNMFBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=MLP-based2026.0645.261.5
EMBERBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=Embedding-only2026.064582.5
EMBERBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=Embedding-only2026.064471.8
RMUBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=MLP-based2026.0643.268.2
CRISPBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=MLP-based2026.0638.372.8
SNMFBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=MLP-based2026.0638.267
SNMF + EMBERBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=MLP-based2026.0637.575.8
PISCES + EMBERBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=MLP-based2026.063780.5
PISCES + EMBERBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=MLP-based2026.0633.580
SNMF + EMBERBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=MLP-based2026.063072.5
MeanBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=Embedding-only2026.062977
NoiseBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=Embedding-only2026.062976.2
CRISPBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=MLP-based2026.0628.762
CRISP + EMBERBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=MLP-based2026.0628.273
CRISP + EMBERBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=MLP-based2026.0627.579
RMUBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=MLP-based2026.0625.274.8
RMU + EMBERBackbone=Gemma-2-2B-it, Evaluation Protocol=MC, Method Category=MLP-based2026.0625.275.8
EMBERBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=Embedding-only2026.062572.5
RMU + EMBERBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=MC, Method Category=MLP-based2026.0621.277.5
SNMFBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=MLP-based2026.0618.241
CRISP + EMBERBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=MLP-based2026.061269.2
RMU + EMBERBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=MLP-based2026.061259.8
SNMFBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=MLP-based2026.061046.2
SNMF + EMBERBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=MLP-based2026.061058
CRISP + EMBERBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=MLP-based2026.069.750.7
RMU + EMBERBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=MLP-based2026.06953.5
PISCES + EMBERBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=MLP-based2026.068.553
RMUBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=MLP-based2026.068.236.2
PISCESBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=MLP-based2026.066.542
PISCES + EMBERBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=MLP-based2026.065.851
CRISPBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=MLP-based2026.065.534.2
PISCESBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=MLP-based2026.065.340
SNMF + EMBERBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=MLP-based2026.064.855.2
RMUBackbone=Llama-3.1-8B-Instruct, Evaluation Protocol=OE, Method Category=MLP-based2026.064.839.5
CRISPBackbone=Gemma-2-2B-it, Evaluation Protocol=OE, Method Category=MLP-based2026.062.533.5