List your company
ResearchFormerly WizWand

Student Simulation on C++_5

86AccCognitive Prototype Mapping
31.9245.966074.04May 26, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Cognitive Prototype MappingBackbone=GPT-4o, Solution Simulation Protocol=IO2025.05863.63.32
Cognitive Prototype MappingBackbone=GPT-4o, Solution Simulation Protocol=CoT2025.05863.63.4
Cognitive Prototype MappingBackbone=GPT-4o, Solution Simulation Protocol=Refine2025.05863.63.42
Level+Similarity RetrievalBackbone=GPT-4o, Solution Simulation Protocol=IO2025.05683.22.6
Level+Similarity RetrievalBackbone=GPT-4o, Solution Simulation Protocol=CoT2025.05683.22.8
Level+Similarity RetrievalBackbone=GPT-4o, Solution Simulation Protocol=Refine2025.05683.22.8
Cognitive Prototype MappingBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=IO2025.05663.162.98
Cognitive Prototype MappingBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=CoT2025.05663.163.1
Cognitive Prototype MappingBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=Refine2025.05663.163.16
Cognitive Prototype MappingBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=IO2025.056232.44
Cognitive Prototype MappingBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=CoT2025.056232.52
Cognitive Prototype MappingBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=Refine2025.056232.52
Similarity-based RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=IO2025.056232.52
Similarity-based RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=CoT2025.056232.36
Similarity-based RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=Refine2025.056232.62
Level+Similarity RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=IO2025.05582.522.46
Level+Similarity RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=CoT2025.05582.522.18
Level+Similarity RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=Refine2025.05582.521.88
Cognitive Prototype MappingBackbone=GPT-3.5, Solution Simulation Protocol=IO2025.05582.72.98
Cognitive Prototype MappingBackbone=GPT-3.5, Solution Simulation Protocol=CoT2025.05582.73.12
Cognitive Prototype MappingBackbone=GPT-3.5, Solution Simulation Protocol=Refine2025.05582.73.18
Similarity-based RetrievalBackbone=GPT-4o, Solution Simulation Protocol=IO2025.05542.683.14
Similarity-based RetrievalBackbone=GPT-4o, Solution Simulation Protocol=CoT2025.05542.683.3
Similarity-based RetrievalBackbone=GPT-4o, Solution Simulation Protocol=Refine2025.05542.682.9
Level+Random RetrievalBackbone=GPT-4o, Solution Simulation Protocol=IO2025.05542.842.32
Level+Random RetrievalBackbone=GPT-4o, Solution Simulation Protocol=CoT2025.05542.842.7
Level+Random RetrievalBackbone=GPT-4o, Solution Simulation Protocol=Refine2025.05542.842.24
Random StrategyBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=IO2025.05522.642.62
Random StrategyBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=CoT2025.05522.642.26
Random StrategyBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=Refine2025.05522.642.26
Similarity-based RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=IO2025.05522.622.92
Similarity-based RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=CoT2025.05522.622.66
Similarity-based RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=Refine2025.05522.622.52
Random StrategyBackbone=GPT-3.5, Solution Simulation Protocol=IO2025.05502.622.98
Random StrategyBackbone=GPT-3.5, Solution Simulation Protocol=CoT2025.05502.622.78
Random StrategyBackbone=GPT-3.5, Solution Simulation Protocol=Refine2025.05502.622.82
Random StrategyBackbone=GPT-4o, Solution Simulation Protocol=IO2025.05502.52.64
Random StrategyBackbone=GPT-4o, Solution Simulation Protocol=CoT2025.05502.53.04
Random StrategyBackbone=GPT-4o, Solution Simulation Protocol=Refine2025.05502.53.1
Level-based RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=IO2025.05482.362.98
Level-based RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=CoT2025.05482.363
Level-based RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=Refine2025.05482.362.8
Level+Random RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=IO2025.05462.221.86
Level+Random RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=CoT2025.05462.221.88
Level+Random RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=Refine2025.05462.222.1
Level+Random RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=IO2025.05442.243.16
Level+Random RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=CoT2025.05442.243.06
Level+Random RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=Refine2025.05442.243.16
Level+Similarity RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=IO2025.05442.32.86
Level+Similarity RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=CoT2025.05442.32.8
Level+Similarity RetrievalBackbone=GPT-3.5, Solution Simulation Protocol=Refine2025.05442.33.16
Level-based RetrievalBackbone=GPT-4o, Solution Simulation Protocol=IO2025.05422.082.42
Level-based RetrievalBackbone=GPT-4o, Solution Simulation Protocol=CoT2025.05422.083.08
Level-based RetrievalBackbone=GPT-4o, Solution Simulation Protocol=Refine2025.05422.082.04
Level-based RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=IO2025.05381.982.32
Level-based RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=CoT2025.05381.982.52
Level-based RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=Refine2025.05381.981.86
Level+Random RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=IO2025.05382.22.1
Level+Random RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=CoT2025.05382.22.28
Level+Random RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=Refine2025.05382.21.8
Level+Similarity RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=IO2025.05382.122.44
Level+Similarity RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=CoT2025.05382.121.9
Level+Similarity RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=Refine2025.05382.122.08
Level-based RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=IO2025.05361.761.94
Level-based RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=CoT2025.05361.761.76
Level-based RetrievalBackbone=Claude-3.5-Sonnet, Solution Simulation Protocol=Refine2025.05361.761.48
Random StrategyBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=IO2025.05342.31.98
Random StrategyBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=CoT2025.05342.32.34
Random StrategyBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=Refine2025.05342.31.86
Similarity-based RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=IO2025.05342.162.22
Similarity-based RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=CoT2025.05342.162.28
Similarity-based RetrievalBackbone=LLaMA-3.3-70B-Instruct, Solution Simulation Protocol=Refine2025.05342.162.2