ACE - Achieving Compliance Excellence by Evaluating Efficiency Key Performance Indicators

Sammanfattning: This paper explores the first steps of achieving compliance excellence by investigating a way of measuring a development team’s compliance to best practices, and evaluating if there is a correlation between the team’s compliance level and their project quality. To measure the compliance level of a development team, the researchers conducted a survey to gather insights about the development process and best practices of 13 different teams at the technology company Sinch. This data is compared to data collected from a repository scanner called Phantom to evaluate how well or not they comply with the mentioned best practices. To serve the first steps of achieving compliance excellence the scope of this study is limited to measure the compliance by analyzing push frequency and amount of reviewers per merge request. While the amount of reviewers proved to be a redundant metric, push frequency analytics gave interesting results providing a way of measuring compliance. The research of finding a correlation between compliance and quality is conducted by comparing the teams’ push frequency with its production outage statistics to find out if an outage occurred because of a new release. Some findings pointing to a possible correlation are made but because of lacking production outage statistics it can not be concluded that there is one.