List your company
ResearchFormerly WizWand

Utility Judgment on GTI-NQ

76.34F1 ScoreITEM-ARs-ExpA
26.638439.541752.44565.3483Jun 17, 2024
Updated 7mo ago

Evaluation results

MethodLinks
ITEM-ARs-ExpALLM=ChatGPT, Approach=Listwise, m-value=32024.0676.34
ITEM-ARs-ExpALLM=ChatGPT, Approach=Listwise, m-value=12024.0674.43
ITEM-As-ExpALLM=ChatGPT, Approach=Listwise, m-value=32024.0673.55
ITEM-As-ExpALLM=ChatGPT, Approach=Listwise, m-value=12024.0672.44
k-samplingLLM=ChatGPT, Approach=Listwise2024.0671.17
ITEM-As-ImpLLM=ChatGPT, Approach=Listwise, m-value=32024.0669.68
ITEM-As-ImpLLM=ChatGPT, Approach=Listwise, m-value=12024.0668.92
UJ-ExapALLM=ChatGPT, Approach=Listwise2024.0666.13
VanillaLLM=ChatGPT, Approach=Listwise2024.0659.37
UJ-ImpALLM=ChatGPT, Approach=Listwise2024.0657.4
ITEM-As-ExpALLM=ChatGPT, Approach=Pointwise, m-value=32024.0655.45
ITEM-As-ExpALLM=ChatGPT, Approach=Pointwise, m-value=12024.0654.89
ITEM-ARs-ExpALLM=Llama3-8B, Approach=Listwise, m-value=32024.0651.22
ITEM-ARs-ExpALLM=Llama3-8B, Approach=Listwise, m-value=12024.0650.77
ITEM-As-ExpALLM=Llama3-8B, Approach=Listwise, m-value=32024.0649.73
ITEM-As-ExpALLM=Llama3-8B, Approach=Listwise, m-value=12024.0649.26
k-samplingLLM=Llama3-8B, Approach=Listwise2024.0649.2
ITEM-As-ExpALLM=Llama3-8B, Approach=Pointwise, m-value=32024.0648.9
ITEM-As-ImpLLM=Llama3-8B, Approach=Listwise, m-value=32024.0648.03
ITEM-As-ExpALLM=Llama3-8B, Approach=Pointwise, m-value=12024.0647.52
ITEM-As-ImpLLM=Llama3-8B, Approach=Listwise, m-value=12024.0647.47
UJ-ExapALLM=Llama3-8B, Approach=Listwise2024.0647.07
ITEM-As-ImpLLM=ChatGPT, Approach=Pointwise, m-value=32024.0643.58
VanillaLLM=Llama3-8B, Approach=Listwise2024.0643.38
UJ-ImpALLM=Llama3-8B, Approach=Listwise2024.0643.31
ITEM-As-ImpLLM=ChatGPT, Approach=Pointwise, m-value=12024.0643.17
UJ-ExapALLM=Llama3-8B, Approach=Pointwise2024.0639.32
UJ-ImpALLM=Llama3-8B, Approach=Pointwise2024.0638.72
ITEM-As-ImpLLM=Llama3-8B, Approach=Pointwise, m-value=32024.0638.34
ITEM-As-ImpLLM=Llama3-8B, Approach=Pointwise, m-value=12024.0637.98
UJ-ImpALLM=ChatGPT, Approach=Pointwise2024.0637.29
UJ-ExapALLM=ChatGPT, Approach=Pointwise2024.0637.17
VanillaLLM=ChatGPT, Approach=Pointwise2024.0635.31
VanillaLLM=Llama3-8B, Approach=Pointwise2024.0628.55