List your company

Repetition Mitigation on NQ

11RepeatScoreDUC (Duplicatus Charm)
9.420.23141.8Apr 19, 2025

Evaluation results

MethodLinks
DUC (Duplicatus Charm)Backbone=Gemma-2-2B2025.04119514.72
DUC (Duplicatus Charm)Backbone=Llama-3.1-8B2025.0411953.97
TopPBackbone=GPT22025.04139382.81
DUC (Duplicatus Charm)Backbone=GPT22025.04149422.51
TopKBackbone=GPT22025.04169333.16
GreedyBackbone=Gemma-2-2B2025.0418925.02
GreedyBackbone=GPT22025.0418917.41
GreedyBackbone=Llama-3.1-8B2025.0419914.98
TopKBackbone=Gemma-2-2B2025.04209165.52
TopPBackbone=Gemma-2-2B2025.04209166.53
TopPBackbone=Llama-3.1-8B2025.0425885.35
TopKBackbone=Llama-3.1-8B2025.0427874.93
BeamBackbone=Llama-3.1-8B2025.0436823.56
BeamBackbone=Gemma-2-2B2025.04477787.64
BeamBackbone=GPT22025.0451714.39