Applying Scrum in Data Science Projects

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review


The rise of big data has led to an increase in data science projects conducted by organizations. Such projects aim to create valuable insights by improving decision making or enhancing an organization's service offering through data-driven services. However, the majority of data science projects still fail to deliver the expected value. To increase the success rate of projects, the use of process models or methodologies is recommended in the literature. Nevertheless, organizations are hardly using them because they are considered too rigid and they do not support the typical iterative and open nature of data science projects. To overcome this problem, this research suggests applying Agile methodologies to data science projects. Agile methodologies were originally developed in the software engineering domain and are characterised by their iterative approach towards software development. In this study, we selected the Scrum approach and integrated it into the CRISP-DM methodology for data science projects using a Design Science Research approach. This new methodology was then evaluated in three different case organizations using expert interviews. Analysis of the expert interviews resulted in a further refinement of the Agile data science methodology proposed by this research.
Original languageEnglish
Title of host publication2020 IEEE 22nd Conference on Business Informatics (CBI 2020)
EditorsWided Guédria, Henderik A. Proper, Jan Verelst, Simon Hacks, Felix Timm, Kurt Sandkuhl, Michael Fellmann, Gabriel Serapiao, Mathias Payan, Mikhail Komarov, Svetlana Maltseva, Raissa Uskenbayeva, Dmitry Nazarov, Mouzhi Ge, Markus Helfert, Lisa Ehrlinger
Place of PublicationDanvers, MA
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages9
ISBN (Electronic)978-1-7281-9926-9
ISBN (Print)978-1-7281-9927-6
Publication statusPublished - 2020
Event22nd IEEE International Conference on Business Informatics - Online, University of Antwerp, Antwerp, Belgium
Duration: 22 Jun 202024 Jun 2020
Conference number: 22


Conference22nd IEEE International Conference on Business Informatics
Abbreviated titleCBI 2020
Internet address


  • Agile
  • Data Science
  • Scrum


Dive into the research topics of 'Applying Scrum in Data Science Projects'. Together they form a unique fingerprint.

Cite this