Community Summary Evaluation on semiconductor C3 (post-cutoff)
67Comprehensiveness Win CountMRC
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| MRCHeuristic Level=LF, Evaluator LLM=GPT-3.5-turbo2026.03 | 67 | 29 | 4 | 69 | 28 | 3 | — | — | — | |
| RkHHeuristic Level=L1, Evaluator LLM=GPT-3.5-turbo2026.03 | 56 | 42 | 2 | 48 | 52 | 0 | — | — | — | |
| M2hCHeuristic Level=LF, Evaluator LLM=GPT-3.5-turbo2026.03 | 54 | 42 | 4 | 54 | 36 | 10 | — | — | — | |
| RkHHeuristic Level=LF, Evaluator LLM=GPT-3.5-turbo2026.03 | 50 | 48 | 2 | 44 | 50 | 6 | — | — | — | |
| MRCHeuristic Level=L1, Evaluator LLM=GPT-3.5-turbo2026.03 | 50 | 46 | 4 | 54 | 44 | 2 | — | — | — | |
| M2hCHeuristic Level=L1, Evaluator LLM=GPT-3.5-turbo2026.03 | 48 | 42 | 10 | 50 | 50 | 0 | — | — | — | |
| M2hCHierarchy level=L1, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 53 | 43 | 4 | |
| M2hCHierarchy level=LF, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 52 | 44 | 4 | |
| MRCHierarchy level=L1, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 57 | 37 | 6 | |
| MRCHierarchy level=LF, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 59 | 36 | 5 | |
| RkHHierarchy level=L1, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 47 | 52 | 1 | |
| RkHHierarchy level=LF, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 50 | 50 | 0 |