Utility Judgment on GTI-NQ benchmark leaderboard · SOTA2 Research

Utility Judgment on GTI-NQ

76.34F1 ScoreITEM-ARs-ExpA

Evaluation Results

Method	Links
ITEM-ARs-ExpA2024.06		76.34
ITEM-ARs-ExpA2024.06		74.43
ITEM-As-ExpA2024.06		73.55
ITEM-As-ExpA2024.06		72.44
k-sampling2024.06		71.17
ITEM-As-Imp2024.06		69.68
ITEM-As-Imp2024.06		68.92
UJ-ExapA2024.06		66.13
Vanilla2024.06		59.37
UJ-ImpA2024.06		57.4
ITEM-As-ExpA2024.06		55.45
ITEM-As-ExpA2024.06		54.89
ITEM-ARs-ExpA2024.06		51.22
ITEM-ARs-ExpA2024.06		50.77
ITEM-As-ExpA2024.06		49.73
ITEM-As-ExpA2024.06		49.26
k-sampling2024.06		49.2
ITEM-As-ExpA2024.06		48.9
ITEM-As-Imp2024.06		48.03
ITEM-As-ExpA2024.06		47.52
ITEM-As-Imp2024.06		47.47
UJ-ExapA2024.06		47.07
ITEM-As-Imp2024.06		43.58
Vanilla2024.06		43.38
UJ-ImpA2024.06		43.31
ITEM-As-Imp2024.06		43.17
UJ-ExapA2024.06		39.32
UJ-ImpA2024.06		38.72
ITEM-As-Imp2024.06		38.34
ITEM-As-Imp2024.06		37.98
UJ-ImpA2024.06		37.29
UJ-ExapA2024.06		37.17
Vanilla2024.06		35.31
Vanilla2024.06		28.55