List your company

Dialogue Response Selection on DailyDialog reformatted multiple-choice (test)

90.35AccuracySirLLM
53.01462.70772.482.093May 21, 2024

Evaluation results

MethodLinks
SirLLMBackbone=Yi-34b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=0.72024.0590.355
StreamLLMBackbone=Yi-34b, Attention Sink Size=4, # Entropy=0, # Recent=508, ηdecay=12024.0585.35—
SirLLMBackbone=Yi-6b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=0.72024.0583.856.95
RandomLLMBackbone=Yi-34b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=12024.0582.17-3.18
StreamLLMBackbone=Yi-6b, Attention Sink Size=4, # Entropy=0, # Recent=508, ηdecay=12024.0576.9—
SirLLMBackbone=Vicuna-13b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=0.62024.0571.40.3
RandomLLMBackbone=Yi-6b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=12024.0571.1-5.8
StreamLLMBackbone=Vicuna-13b, Attention Sink Size=4, # Entropy=0, # Recent=508, ηdecay=12024.0571.1—
IntervalLLMBackbone=Yi-34b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=12024.0570.7-14.65
RandomLLMBackbone=Vicuna-13b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=12024.0569.27-1.83
IntervalLLMBackbone=Yi-6b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=12024.0565.2-11.7
IntervalLLMBackbone=Vicuna-13b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=12024.0562.05-9.05
SirLLMBackbone=Vicuna-7b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=0.52024.0559.151.6
StreamLLMBackbone=Vicuna-7b, Attention Sink Size=4, # Entropy=0, # Recent=508, ηdecay=12024.0557.55—
RandomLLMBackbone=Vicuna-7b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=12024.0557.48-0.13
IntervalLLMBackbone=Vicuna-7b, Attention Sink Size=4, # Entropy=508, # Recent=0, ηdecay=12024.0554.45-3.1