List your company
ResearchFormerly WizWand

Grounded Generation on QAMPARI (test)

30.28Correctness PrecisionCaLM
5.704812.084918.46524.8451Jun 8, 2024
Updated 8mo ago

Evaluation results

MethodLinks
CaLMMethod Type=Postprocess, # Main LM Call=<4, # Verifier LM Call=<3, Main LM=text-unicorn, Retriever=GTR2024.0630.2822.7928.5328.3427.49
Snippet + ICLCiteMethod Type=Preprocess, # Main LM Call=10, Main LM=text-unicorn, Retriever=GTR2024.0627.2625.0725.9625.5525.96
Summ + ICLCiteMethod Type=Preprocess, # Main LM Call=10, Main LM=text-unicorn, Retriever=GTR2024.0627.1126.1424.6124.9825.71
CaLMMethod Type=Postprocess, # Main LM Call=<4, # Verifier LM Call=<3, Main LM=GPT-3.5-Turbo-1106, Retriever=GTR2024.0626.7118.5525.1624.3923.7
ICLCite + USCMethod Type=Postprocess, # Main LM Call=10, Main LM=text-unicorn, Retriever=GTR2024.0626.3422.125.4825.1924.78
ICLCiteMethod Type=Single Run, # Main LM Call=1, Main LM=text-unicorn, Retriever=GTR2024.0626.2721.4225.5225.2124.61
Snippet + ICLCiteMethod Type=Preprocess, # Main LM Call=10, Main LM=GPT-3.5-Turbo-1106, Retriever=GTR2024.0620.4817.1825.4523.9121.76
CaLMMethod Type=Postprocess, # Main LM Call=<4, # Verifier LM Call=<3, Main LM=text-unicorn, Retriever=DPR2024.0619.6216.7115.915.9517.05
ICLCiteMethod Type=Single Run, # Main LM Call=1, Main LM=GPT-3.5-Turbo-1106, Retriever=GTR2024.0619.2317.3221.7520.7719.77
Snippet + ICLCiteMethod Type=Preprocess, # Main LM Call=10, Main LM=text-unicorn, Retriever=DPR2024.0618.8115.1116.115.8316.46
Summ + ICLCiteMethod Type=Preprocess, # Main LM Call=10, Main LM=text-unicorn, Retriever=DPR2024.0618.6115.1715.6115.3616.19
CaLMMethod Type=Postprocess, # Main LM Call=<4, # Verifier LM Call=<3, Main LM=GPT-3.5-Turbo-1106, Retriever=DPR2024.0617.6513.6113.9312.9914.55
ICLCiteMethod Type=Single Run, # Main LM Call=1, Main LM=text-unicorn, Retriever=DPR2024.0617.0612.5515.7715.5915.24
ICLCite + USCMethod Type=Postprocess, # Main LM Call=10, Main LM=text-unicorn, Retriever=DPR2024.0617.0412.4715.8115.6215.24
Summ + ICLCiteMethod Type=Preprocess, # Main LM Call=10, Main LM=GPT-3.5-Turbo-1106, Retriever=GTR2024.0615.0613.121.892117.76
ICLCite + USCMethod Type=Postprocess, # Main LM Call=10, Main LM=GPT-3.5-Turbo-1106, Retriever=GTR2024.0614.0712.4517.3416.615.12
ICLCiteMethod Type=Single Run, # Main LM Call=1, Main LM=GPT-3.5-Turbo-1106, Retriever=DPR2024.0612.4710.2812.611.6211.74
Snippet + ICLCiteMethod Type=Preprocess, # Main LM Call=10, Main LM=GPT-3.5-Turbo-1106, Retriever=DPR2024.0611.677.8714.1412.6411.58
ICLCite + USCMethod Type=Postprocess, # Main LM Call=10, Main LM=GPT-3.5-Turbo-1106, Retriever=DPR2024.069.888.3610.149.289.42
Summ + ICLCiteMethod Type=Preprocess, # Main LM Call=10, Main LM=GPT-3.5-Turbo-1106, Retriever=DPR2024.066.654.9710.569.437.9