Defining and Assessing Risk Analysis: The Key to Strategic Iteration in Real-World Problem Solving

Abstract

Across domains from science to civics, experts plan to solve real-world problems iteratively. Despite the importance of strategic iteration, we lack precise understandings of effective iterative planning and novice challenges, making it difficult to assess formatively and therefore to teach. We conducted design-based research to understand iterative planning and design assessment tools in a full-time 6-week program where undergraduate teams worked on social impact design problems. We found that iterative planning requires a process of risk analysis: detecting risks in the problem space, prioritizing those risks, and setting goals to reduce them. Novices struggled with each step of risk analysis, so they did not plan iterations strategically. We designed assessment tools that surface students’ thinking about risk analysis and support instructors to notice common challenges. We contribute detailed understandings of iterative planning and novice challenges as well as tools that can be adapted to assess real-world problem solving across domains.