Validation and Clarification of Critical Success Factors of DevOps Processes

Context: Critical Success Factors (CSFs) may contribute to solve challenges regarding Continuous Integration, Continuous Delivery and Continuous Deployment processes (CI/CD-processes). Prior research found some CSFs related to CI/CD and aspects of DevOps, but they are limited regarding validation, clarification and comprehensiveness. Objective: This study aims to contribute to the success of CI/CD-processes by showing and clarifying which CSFs determine the success of CI/CD-processes. Method: A three-phase process was followed. In the first phase, we conducted a systematic literature review in which we identified 144 potential CSFs. In the second phase, we classified the CSFs found into nineteen potential CSFs. Finally, we conducted a multiple case study with the following objectives: (1) to find examples of application to show that the potential CSFs were recognized by experts in the field, (2) to use the examples to validate the potential CSFs and show how the CSFs could be operationalized, and (3) to clarify why the validated CSFs are important to the success of CI/CD-processes. Results: Our main contribution to theory is a validated and structured model of nineteen clarified CSFs of CI/CD-processes, which were understood, recognized and grounded in practice by examples and clarifications on the importance of CSFs. Conclusions: Presenting a comprehensive model of CSFs, it appears that we achieved consensus regarding CSFs of CI/CD-processes in literature. In addition, IT-organizations could apply this model of CSFs to take steps towards successful results of CI/CD-processes.