Evaluating an emergency management decision support system with practitioner-driven scenarios: action design research

Abstract

Evaluating an IT artifact is essential in design science, as it serves to validate that a solution has achieved the purpose for which it was designed. This paper presents the evaluation of an emergency management (EM) decision support system (DSS). The DSS addresses the informational needs of strategic-level decision makers in the event of large-scale disasters. Disasters, by their very nature, are complex and unpredictable, require emergency responders to make rapid high risk decisions with the potential for life threatening and economically devastating results. This study details a phased evaluation using three scenarios: (1) Biological Hazard Response, (2) Cross-Border Chemical Explosion and Bio-Hazard, and (3) Regional and Interregional Mass Flooding. The mixed method evaluation elicited participant feedback to test usability and utility, guided by action design research. To ensure parity between scenarios, an existing EM framework informed scenario design with the unique addition of the DSS to support end-user processes.