Proposal Selection Cost Evaluation on SNS Proposal Review
11,935Cost Ratio (Human/LLM)LLM-empowered pairwise preference approach
Evaluation results
| Method | Links | |
|---|---|---|
| LLM-empowered pairwise preference approachEvaluation scale=per review, Human evaluation protocol=Individual scoring, LLM evaluation protocol=Pairwise preference2025.12 | 11,935 | |
| LLM-empowered pairwise preference approachEvaluation scale=pool-based, Number of proposals (N)=30, Human evaluation protocol=Individual scoring, LLM evaluation protocol=Pairwise preference2025.12 | 823 | |
| LLM-empowered pairwise preference approachEvaluation scale=pool-based, Number of proposals (N)=70, Human evaluation protocol=Individual scoring, LLM evaluation protocol=Pairwise preference2025.12 | 346 |