Utility Judgment on WebAP
40.78F1 ScoreITEM-As w. ImpA
Evaluation Results
| Method | Links | |
|---|---|---|
| ITEM-As w. ImpAapproach=Listwise, LLM=ChatGPT, m-value=32024.06 | 40.78 | |
| ITEM-As w. ExpAapproach=Listwise, LLM=ChatGPT, m-value=32024.06 | 39.57 | |
| ITEM-ARs w. ExpAapproach=Listwise, LLM=ChatGPT, m-value=32024.06 | 38.58 | |
| ITEM-ARs w. ExpAapproach=Listwise, LLM=Mistral, m-value=32024.06 | 37.06 | |
| ITEM-As w. ExpAapproach=Listwise, LLM=ChatGPT, m-value=12024.06 | 36.89 | |
| ITEM-ARs w. ExpAapproach=Listwise, LLM=ChatGPT, m-value=12024.06 | 36.58 | |
| ITEM-ARs w. ExpAapproach=Listwise, LLM=Mistral, m-value=12024.06 | 35.5 | |
| ITEM-As w. ImpAapproach=Listwise, LLM=ChatGPT, m-value=12024.06 | 34.97 | |
| ITEM-As w. ExpAapproach=Pointwise, LLM=Llama 3, m-value=32024.06 | 32.67 | |
| ITEM-As w. ImpAapproach=Pointwise, LLM=ChatGPT, m-value=32024.06 | 32.54 | |
| ITEM-As w. ExpAapproach=Pointwise, LLM=ChatGPT, m-value=12024.06 | 32.02 | |
| ITEM-As w. ExpAapproach=Listwise, LLM=Mistral, m-value=32024.06 | 31.65 | |
| 5-samplingapproach=Listwise, LLM=ChatGPT2024.06 | 31.49 | |
| ITEM-ARs w. ExpAapproach=Listwise, LLM=Llama 3, m-value=12024.06 | 31.44 | |
| ITEM-As w. ExpAapproach=Pointwise, LLM=ChatGPT, m-value=32024.06 | 31.43 | |
| ITEM-As w. ExpAapproach=Pointwise, LLM=Llama 3, m-value=12024.06 | 31.08 | |
| ITEM-As w. ImpAapproach=Pointwise, LLM=Llama 3, m-value=12024.06 | 30.53 | |
| UJ-ExpAapproach=Listwise, LLM=ChatGPT2024.06 | 30.5 | |
| ITEM-As w. ExpAapproach=Pointwise, LLM=Mistral, m-value=32024.06 | 30.5 | |
| 5-samplingapproach=Listwise, LLM=Mistral2024.06 | 30.16 | |
| ITEM-As w. ImpAapproach=Pointwise, LLM=Mistral, m-value=32024.06 | 30.13 | |
| UJ-ImpAapproach=Listwise, LLM=ChatGPT2024.06 | 29.89 | |
| ITEM-As w. ExpAapproach=Listwise, LLM=Mistral, m-value=12024.06 | 29.76 | |
| ITEM-As w. ImpAapproach=Pointwise, LLM=Llama 3, m-value=32024.06 | 29.64 | |
| ITEM-As w. ImpAapproach=Pointwise, LLM=ChatGPT, m-value=12024.06 | 29.34 | |
| ITEM-As w. ExpAapproach=Listwise, LLM=Llama 3, m-value=32024.06 | 29.32 | |
| UJ-ExpAapproach=Pointwise, LLM=Llama 32024.06 | 29.25 | |
| ITEM-As w. ExpAapproach=Pointwise, LLM=Mistral, m-value=12024.06 | 29.1 | |
| ITEM-ARs w. ExpAapproach=Listwise, LLM=Llama 3, m-value=32024.06 | 29.08 | |
| 5-samplingapproach=Listwise, LLM=Llama 32024.06 | 28.97 | |
| Vanillaapproach=Listwise, LLM=ChatGPT2024.06 | 28.43 | |
| ITEM-As w. ImpAapproach=Listwise, LLM=Mistral, m-value=32024.06 | 28.36 | |
| UJ-ImpAapproach=Pointwise, LLM=Mistral2024.06 | 28.35 | |
| ITEM-As w. ImpAapproach=Pointwise, LLM=Mistral, m-value=12024.06 | 28.28 | |
| UJ-ExpAapproach=Listwise, LLM=Mistral2024.06 | 27.94 | |
| ITEM-As w. ExpAapproach=Listwise, LLM=Llama 3, m-value=12024.06 | 27.5 | |
| UJ-ExpAapproach=Pointwise, LLM=ChatGPT2024.06 | 27.44 | |
| UJ-ExpAapproach=Listwise, LLM=Llama 32024.06 | 26.99 | |
| Vanillaapproach=Pointwise, LLM=ChatGPT2024.06 | 26.85 | |
| UJ-ImpAapproach=Pointwise, LLM=ChatGPT2024.06 | 26.32 | |
| UJ-ImpAapproach=Listwise, LLM=Llama 32024.06 | 26.22 | |
| ITEM-As w. ImpAapproach=Listwise, LLM=Llama 3, m-value=32024.06 | 26.1 | |
| ITEM-As w. ImpAapproach=Listwise, LLM=Mistral, m-value=12024.06 | 26.06 | |
| ITEM-As w. ImpAapproach=Listwise, LLM=Llama 3, m-value=12024.06 | 25.59 | |
| UJ-ImpAapproach=Pointwise, LLM=Llama 32024.06 | 25.29 | |
| UJ-ExpAapproach=Pointwise, LLM=Mistral2024.06 | 25.27 | |
| Vanillaapproach=Pointwise, LLM=Llama 32024.06 | 25.09 | |
| UJ-ImpAapproach=Listwise, LLM=Mistral2024.06 | 25.06 | |
| Vanillaapproach=Pointwise, LLM=Mistral2024.06 | 23.05 | |
| Vanillaapproach=Listwise, LLM=Llama 32024.06 | 21.79 | |
| Vanillaapproach=Listwise, LLM=Mistral2024.06 | 20.79 |