Applying Scrum in Data Science Projects

Jeroen Baijens; Remko W. Helms; Deniz Iren

doi:10.1109/CBI49978.2020.00011

Applying Scrum in Data Science Projects

Jeroen Baijens, Remko W. Helms, Deniz Iren

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceeding › Academic › peer-review

Abstract

The rise of big data has led to an increase in data science projects conducted by organizations. Such projects aim to create valuable insights by improving decision making or enhancing an organization's service offering through data-driven services. However, the majority of data science projects still fail to deliver the expected value. To increase the success rate of projects, the use of process models or methodologies is recommended in the literature. Nevertheless, organizations are hardly using them because they are considered too rigid and they do not support the typical iterative and open nature of data science projects. To overcome this problem, this research suggests applying Agile methodologies to data science projects. Agile methodologies were originally developed in the software engineering domain and are characterised by their iterative approach towards software development. In this study, we selected the Scrum approach and integrated it into the CRISP-DM methodology for data science projects using a Design Science Research approach. This new methodology was then evaluated in three different case organizations using expert interviews. Analysis of the expert interviews resulted in a further refinement of the Agile data science methodology proposed by this research.

Original language	English
Title of host publication	2020 IEEE 22nd Conference on Business Informatics (CBI 2020)
Editors	Wided Guédria, Henderik A. Proper, Jan Verelst, Simon Hacks, Felix Timm, Kurt Sandkuhl, Michael Fellmann, Gabriel Serapiao, Mathias Payan, Mikhail Komarov, Svetlana Maltseva, Raissa Uskenbayeva, Dmitry Nazarov, Mouzhi Ge, Markus Helfert, Lisa Ehrlinger
Place of Publication	Danvers, MA
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	30-38
Number of pages	9
Volume	2
ISBN (Electronic)	978-1-7281-9926-9
ISBN (Print)	978-1-7281-9927-6
DOIs	https://doi.org/10.1109/CBI49978.2020.00011
Publication status	Published - 2020
Event	22nd IEEE International Conference on Business Informatics - Online, University of Antwerp, Antwerp, Belgium Duration: 22 Jun 2020 → 24 Jun 2020 Conference number: 22 http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=97496&copyownerid=86190

Conference

Conference	22nd IEEE International Conference on Business Informatics
Abbreviated title	CBI 2020
Country	Belgium
City	Antwerp
Period	22/06/20 → 24/06/20
Internet address	http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=97496&copyownerid=86190

Keywords

Agile
Data Science
Scrum

Access to Document

10.1109/CBI49978.2020.00011

Fingerprint Dive into the research topics of 'Applying Scrum in Data Science Projects'. Together they form a unique fingerprint.

Cite this

Baijens, J., Helms, R. W., & Iren, D. (2020). Applying Scrum in Data Science Projects. In W. Guédria, H. A. Proper, J. Verelst, S. Hacks, F. Timm, K. Sandkuhl, M. Fellmann, G. Serapiao, M. Payan, M. Komarov, S. Maltseva, R. Uskenbayeva, D. Nazarov, M. Ge, M. Helfert, & L. Ehrlinger (Eds.), 2020 IEEE 22nd Conference on Business Informatics (CBI 2020) (Vol. 2, pp. 30-38). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CBI49978.2020.00011

Baijens, Jeroen ; Helms, Remko W. ; Iren, Deniz. / Applying Scrum in Data Science Projects. 2020 IEEE 22nd Conference on Business Informatics (CBI 2020). editor / Wided Guédria ; Henderik A. Proper ; Jan Verelst ; Simon Hacks ; Felix Timm ; Kurt Sandkuhl ; Michael Fellmann ; Gabriel Serapiao ; Mathias Payan ; Mikhail Komarov ; Svetlana Maltseva ; Raissa Uskenbayeva ; Dmitry Nazarov ; Mouzhi Ge ; Markus Helfert ; Lisa Ehrlinger. Vol. 2 Danvers, MA : Institute of Electrical and Electronics Engineers Inc., 2020. pp. 30-38

@inproceedings{01ef61e1fac74da6a4589059b918da93,

title = "Applying Scrum in Data Science Projects",

abstract = "The rise of big data has led to an increase in data science projects conducted by organizations. Such projects aim to create valuable insights by improving decision making or enhancing an organization's service offering through data-driven services. However, the majority of data science projects still fail to deliver the expected value. To increase the success rate of projects, the use of process models or methodologies is recommended in the literature. Nevertheless, organizations are hardly using them because they are considered too rigid and they do not support the typical iterative and open nature of data science projects. To overcome this problem, this research suggests applying Agile methodologies to data science projects. Agile methodologies were originally developed in the software engineering domain and are characterised by their iterative approach towards software development. In this study, we selected the Scrum approach and integrated it into the CRISP-DM methodology for data science projects using a Design Science Research approach. This new methodology was then evaluated in three different case organizations using expert interviews. Analysis of the expert interviews resulted in a further refinement of the Agile data science methodology proposed by this research.",

keywords = "Agile, Data Science, Scrum",

author = "Jeroen Baijens and Helms, {Remko W.} and Deniz Iren",

year = "2020",

doi = "10.1109/CBI49978.2020.00011",

language = "English",

isbn = "978-1-7281-9927-6",

volume = "2",

pages = "30--38",

editor = "Gu{\'e}dria, {Wided } and Proper, {Henderik A. } and Verelst, {Jan } and Hacks, {Simon } and Timm, {Felix } and Sandkuhl, {Kurt } and Fellmann, {Michael } and Serapiao, {Gabriel } and Payan, {Mathias } and Komarov, {Mikhail } and Maltseva, {Svetlana } and Uskenbayeva, {Raissa } and Nazarov, {Dmitry } and Mouzhi Ge and Helfert, {Markus } and Ehrlinger, {Lisa }",

booktitle = "2020 IEEE 22nd Conference on Business Informatics (CBI 2020)",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

address = "United States",

note = "22nd IEEE International Conference on Business Informatics, CBI 2020 ; Conference date: 22-06-2020 Through 24-06-2020",

url = "http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=97496&copyownerid=86190",

}

Baijens, J , Helms, RW & Iren, D 2020, Applying Scrum in Data Science Projects. in W Guédria, HA Proper, J Verelst, S Hacks, F Timm, K Sandkuhl, M Fellmann, G Serapiao, M Payan, M Komarov, S Maltseva, R Uskenbayeva, D Nazarov, M Ge, M Helfert & L Ehrlinger (eds), 2020 IEEE 22nd Conference on Business Informatics (CBI 2020). vol. 2, Institute of Electrical and Electronics Engineers Inc., Danvers, MA, pp. 30-38, 22nd IEEE International Conference on Business Informatics, Antwerp, Belgium, 22/06/20. https://doi.org/10.1109/CBI49978.2020.00011

Applying Scrum in Data Science Projects. / Baijens, Jeroen ; Helms, Remko W.; Iren, Deniz.

2020 IEEE 22nd Conference on Business Informatics (CBI 2020). ed. / Wided Guédria; Henderik A. Proper; Jan Verelst; Simon Hacks; Felix Timm; Kurt Sandkuhl; Michael Fellmann; Gabriel Serapiao; Mathias Payan; Mikhail Komarov; Svetlana Maltseva; Raissa Uskenbayeva; Dmitry Nazarov; Mouzhi Ge; Markus Helfert; Lisa Ehrlinger. Vol. 2 Danvers, MA : Institute of Electrical and Electronics Engineers Inc., 2020. p. 30-38.

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceeding › Academic › peer-review

TY - GEN

T1 - Applying Scrum in Data Science Projects

AU - Baijens, Jeroen

AU - Helms, Remko W.

AU - Iren, Deniz

N1 - Conference code: 22

PY - 2020

Y1 - 2020

N2 - The rise of big data has led to an increase in data science projects conducted by organizations. Such projects aim to create valuable insights by improving decision making or enhancing an organization's service offering through data-driven services. However, the majority of data science projects still fail to deliver the expected value. To increase the success rate of projects, the use of process models or methodologies is recommended in the literature. Nevertheless, organizations are hardly using them because they are considered too rigid and they do not support the typical iterative and open nature of data science projects. To overcome this problem, this research suggests applying Agile methodologies to data science projects. Agile methodologies were originally developed in the software engineering domain and are characterised by their iterative approach towards software development. In this study, we selected the Scrum approach and integrated it into the CRISP-DM methodology for data science projects using a Design Science Research approach. This new methodology was then evaluated in three different case organizations using expert interviews. Analysis of the expert interviews resulted in a further refinement of the Agile data science methodology proposed by this research.

AB - The rise of big data has led to an increase in data science projects conducted by organizations. Such projects aim to create valuable insights by improving decision making or enhancing an organization's service offering through data-driven services. However, the majority of data science projects still fail to deliver the expected value. To increase the success rate of projects, the use of process models or methodologies is recommended in the literature. Nevertheless, organizations are hardly using them because they are considered too rigid and they do not support the typical iterative and open nature of data science projects. To overcome this problem, this research suggests applying Agile methodologies to data science projects. Agile methodologies were originally developed in the software engineering domain and are characterised by their iterative approach towards software development. In this study, we selected the Scrum approach and integrated it into the CRISP-DM methodology for data science projects using a Design Science Research approach. This new methodology was then evaluated in three different case organizations using expert interviews. Analysis of the expert interviews resulted in a further refinement of the Agile data science methodology proposed by this research.

KW - Agile

KW - Data Science

KW - Scrum

U2 - 10.1109/CBI49978.2020.00011

DO - 10.1109/CBI49978.2020.00011

M3 - Conference article in proceeding

SN - 978-1-7281-9927-6

VL - 2

SP - 30

EP - 38

BT - 2020 IEEE 22nd Conference on Business Informatics (CBI 2020)

A2 - Guédria, Wided

A2 - Proper, Henderik A.

A2 - Verelst, Jan

A2 - Hacks, Simon

A2 - Timm, Felix

A2 - Sandkuhl, Kurt

A2 - Fellmann, Michael

A2 - Serapiao, Gabriel

A2 - Payan, Mathias

A2 - Komarov, Mikhail

A2 - Maltseva, Svetlana

A2 - Uskenbayeva, Raissa

A2 - Nazarov, Dmitry

A2 - Ge, Mouzhi

A2 - Helfert, Markus

A2 - Ehrlinger, Lisa

PB - Institute of Electrical and Electronics Engineers Inc.

CY - Danvers, MA

T2 - 22nd IEEE International Conference on Business Informatics

Y2 - 22 June 2020 through 24 June 2020

ER -

Baijens J , Helms RW , Iren D. Applying Scrum in Data Science Projects. In Guédria W, Proper HA, Verelst J, Hacks S, Timm F, Sandkuhl K, Fellmann M, Serapiao G, Payan M, Komarov M, Maltseva S, Uskenbayeva R, Nazarov D, Ge M, Helfert M, Ehrlinger L, editors, 2020 IEEE 22nd Conference on Business Informatics (CBI 2020). Vol. 2. Danvers, MA: Institute of Electrical and Electronics Engineers Inc. 2020. p. 30-38 https://doi.org/10.1109/CBI49978.2020.00011