A roadmap for using continuous integration environments

Quality attribute evaluation in many software companies is often conducted in an ad-hoc manner, leading to inefficient work and undetected defects. Continuous Integration (CI) environments can mitigate these issues through timely feedback and early detection. However, frameworks on using CI for quality evaluation are lacking. We conducted a multi-case study interviewing 22 industrial participants through semi-structured interviews across four software development companies to explore how CI environments support quality evaluation. Based on the study, we present a model visualizing CI’s role in quality attribute evaluation. We introduce common metrics used and propose a hierarchical decision model for improving CI’s quality attribute evaluation capabilities over time. This work provides companies with practical guidelines and a decision model to leverage CI environments for more effective quality attribute evaluation.

Download paper here