List your company
ResearchFormerly WizWand

Utility Judgment on TREC DL

63.18F1 ScoreITEM-As w. ExpA
42.74448.049553.35558.6605Jun 17, 2024
Updated 6mo ago

Evaluation results

MethodLinks
ITEM-As w. ExpAapproach=Listwise, LLM=ChatGPT, m-value=32024.0663.18
ITEM-As w. ExpAapproach=Listwise, LLM=ChatGPT, m-value=12024.0662.52
ITEM-ARs w. ExpAapproach=Listwise, LLM=ChatGPT, m-value=12024.0662
ITEM-ARs w. ExpAapproach=Listwise, LLM=ChatGPT, m-value=32024.0661.37
ITEM-As w. ImpAapproach=Listwise, LLM=ChatGPT, m-value=32024.0660.56
5-samplingapproach=Listwise, LLM=ChatGPT2024.0660.49
ITEM-As w. ImpAapproach=Listwise, LLM=ChatGPT, m-value=12024.0658.11
UJ-ExpAapproach=Listwise, LLM=ChatGPT2024.0657.49
ITEM-ARs w. ExpAapproach=Listwise, LLM=Mistral, m-value=32024.0656.27
UJ-ImpAapproach=Listwise, LLM=ChatGPT2024.0656.18
ITEM-As w. ExpAapproach=Listwise, LLM=Llama 3, m-value=32024.0656.03
ITEM-As w. ExpAapproach=Pointwise, LLM=ChatGPT, m-value=32024.0655.74
Vanillaapproach=Listwise, LLM=ChatGPT2024.0655.19
ITEM-As w. ImpAapproach=Listwise, LLM=Llama 3, m-value=32024.0655.14
ITEM-As w. ImpAapproach=Pointwise, LLM=ChatGPT, m-value=32024.0654.9
ITEM-As w. ExpAapproach=Listwise, LLM=Mistral, m-value=32024.0654.86
ITEM-As w. ImpAapproach=Pointwise, LLM=ChatGPT, m-value=12024.0654.61
UJ-ExpAapproach=Listwise, LLM=Mistral2024.0654.1
ITEM-As w. ExpAapproach=Listwise, LLM=Mistral, m-value=12024.0653.78
ITEM-As w. ImpAapproach=Pointwise, LLM=Llama 3, m-value=32024.0653.76
UJ-ExpAapproach=Pointwise, LLM=Llama 32024.0653.73
ITEM-As w. ImpAapproach=Listwise, LLM=Llama 3, m-value=12024.0653.73
ITEM-As w. ImpAapproach=Pointwise, LLM=Llama 3, m-value=12024.0653.68
ITEM-As w. ExpAapproach=Listwise, LLM=Llama 3, m-value=12024.0653.66
ITEM-As w. ExpAapproach=Pointwise, LLM=ChatGPT, m-value=12024.0653.61
UJ-ExpAapproach=Listwise, LLM=Llama 32024.0652.83
5-samplingapproach=Listwise, LLM=Llama 32024.0652.68
ITEM-As w. ExpAapproach=Pointwise, LLM=Llama 3, m-value=32024.0652.46
ITEM-ARs w. ExpAapproach=Listwise, LLM=Mistral, m-value=12024.0652.34
5-samplingapproach=Listwise, LLM=Mistral2024.0652.31
ITEM-ARs w. ExpAapproach=Listwise, LLM=Llama 3, m-value=32024.0652.1
ITEM-As w. ExpAapproach=Pointwise, LLM=Llama 3, m-value=12024.0652.09
ITEM-As w. ImpAapproach=Listwise, LLM=Mistral, m-value=32024.0652.05
ITEM-As w. ExpAapproach=Pointwise, LLM=Mistral, m-value=32024.0651.74
UJ-ImpAapproach=Pointwise, LLM=Llama 32024.0650.2
Vanillaapproach=Pointwise, LLM=ChatGPT2024.0649.84
ITEM-As w. ExpAapproach=Pointwise, LLM=Mistral, m-value=12024.0649.44
Vanillaapproach=Listwise, LLM=Llama 32024.0649.39
ITEM-As w. ImpAapproach=Listwise, LLM=Mistral, m-value=12024.0649.39
ITEM-ARs w. ExpAapproach=Listwise, LLM=Llama 3, m-value=12024.0648.97
UJ-ImpAapproach=Pointwise, LLM=ChatGPT2024.0648.83
UJ-ImpAapproach=Pointwise, LLM=Mistral2024.0648.31
UJ-ImpAapproach=Listwise, LLM=Mistral2024.0648.29
UJ-ImpAapproach=Listwise, LLM=Llama 32024.0648.22
UJ-ExpAapproach=Pointwise, LLM=ChatGPT2024.0648.09
Vanillaapproach=Pointwise, LLM=Llama 32024.0647.64
ITEM-As w. ImpAapproach=Pointwise, LLM=Mistral, m-value=32024.0646.59
ITEM-As w. ImpAapproach=Pointwise, LLM=Mistral, m-value=12024.0646.01
Vanillaapproach=Listwise, LLM=Mistral2024.0645.67
Vanillaapproach=Pointwise, LLM=Mistral2024.0645.11
UJ-ExpAapproach=Pointwise, LLM=Mistral2024.0643.53