List your company

Passage-pair linking on Literary analysis corpus (Goodreads, Sparknotes, Litcharts)

17PrecisionRetell-summarize
8.88810.99413.115.206May 29, 2025

Evaluation results

MethodLinks
Retell-summarizeModel=Phi-3.5-mini, k=5382025.05172
Retell-describeModel=Phi-3.5-mini, k=5382025.0515.92.1
Retell-summarizeModel=Llama 3.1 8B, k=2062025.0515.54
Retell-describeModel=GPT-4o mini, k=892025.0515.48.2
Retell-describeModel=Llama 3.1 8B, k=2062025.0514.93.9
TopicGPT-liteModel=GPT-4o mini, k=892025.0514.818.6
Retell-summarizeModel=Gemma 2 2B, k=1572025.0514.74.5
Retell-describeModel=Gemma 2 2B, k=1572025.0514.54.6
Retell-summarizeModel=GPT-4o mini, k=502025.0514.111.6
Retell-summarizeModel=GPT-4o mini, k=892025.0514.17.9
TopicGPT-liteModel=Phi-3.5-mini, k=5382025.0513.94.8
TopicGPT-liteModel=Gemma 2 2B, k=1572025.0513.920.1
Retell-paraphraseModel=Gemma 2 2B, k=1572025.0513.84.4
Retell-describeModel=GPT-4o mini, k=502025.0513.711.8
Retell-paraphraseModel=Llama 3.1 8B, k=2062025.0513.53.6
Retell-describeModel=Gemma 2 2B, k=502025.0513.311.1
Retell-summarizeModel=Phi-3.5-mini, k=502025.0513.111.2
Retell-describeModel=Phi-3.5-mini, k=502025.0513.111.6
Retell-summarizeModel=Gemma 2 2B, k=502025.0513.111.1
Retell-summarizeModel=Llama 3.1 8B, k=502025.0512.810.3
Retell-describeModel=Llama 3.1 8B, k=502025.0512.810.7
Retell-paraphraseModel=Phi-3.5-mini, k=5382025.0512.81.7
TopicGPT-liteModel=Llama 3.1 8B, k=2062025.0512.721.1
TopicGPT-liteModel=GPT-4o mini, k=142025.0512.724.8
Retell-paraphraseModel=Gemma 2 2B, k=502025.0512.311
Retell-paraphraseModel=Llama 3.1 8B, k=502025.0512.110.5
Retell-describeModel=GPT-4o mini, k=142025.0511.824.3
default LDA (no LM)Model=Phi-3.5-mini, k=5382025.0511.41.8
Retell-paraphraseModel=GPT-4o mini, k=892025.0511.26.8
Retell-paraphraseModel=Phi-3.5-mini, k=502025.051110.6
Retell-summarizeModel=GPT-4o mini, k=142025.051124.4
default LDA (no LM)Model=Llama 3.1 8B, k=2062025.0510.73.6
Retell-paraphraseModel=GPT-4o mini, k=502025.0510.610.5
default LDA (no LM)Model=GPT-4o mini, k=892025.0510.56.9
default LDA (no LM)Model=Gemma 2 2B, k=1572025.0510.44.2
default LDA (no LM)Model=Llama 3.1 8B, k=502025.051010.8
default LDA (no LM)Model=Phi-3.5-mini, k=502025.051010.8
default LDA (no LM)Model=Gemma 2 2B, k=502025.051010.8
default LDA (no LM)Model=GPT-4o mini, k=502025.051010.8
Retell-paraphraseModel=GPT-4o mini, k=142025.051022.6
default LDA (no LM)Model=GPT-4o mini, k=142025.059.222.2