Article In: scopus

DevOps Metrics and KPIs: A Multivocal Literature Review

ACM Computing Surveys

Amaro R.; Pereira R.; Mira Da Silva M. — 2024 — Association for Computing Machinery (ACM)

Key information

Authors:

Amaro R.; Pereira R.; Mira Da Silva M. (Miguel Mira da Silva)

Published in

04/25/2024

Abstract

<jats:p> <jats:bold>Context:</jats:bold> Information Technology organizations are aiming to implement DevOps capabilities to fulfill market, customer, and internal needs. While many are successful with DevOps implementation, others still have difficulty measuring DevOps success in their organization. As a result, the effectiveness of assessing DevOps remains erratic. This emphasizes the need to withstand management in measuring the implementation process with suitable DevOps Metrics. But what are these metrics? </jats:p> <jats:p> <jats:bold>Objective:</jats:bold> This research seeks to provide relevant DevOps Metrics to facilitate the efficiency of DevOps adoption and better analyze DevOps performance in enterprises. </jats:p> <jats:p> <jats:bold>Method:</jats:bold> A Multivocal Literature Review (MLR) is conducted, with 139 documents gathered and thoroughly examined from throughout the community, including books, scientific articles, white papers, conferences, among others. </jats:p> <jats:p> <jats:bold>Results:</jats:bold> This article conducts an extensive and rigorous MLR, contributing with a definition of DevOps Metrics, 22 main metrics, their definitions, importance, and categorization in sets of Key Performance Indicators, as well as exposing clear indicators on how to improve them. It is also discussed how metrics could be put into practice and what constitutes a change in the context of DevOps Metrics. The study’s outcomes will assist researchers and practitioners understand DevOps Metrics and how to better implement them. </jats:p>

Publication details

Authors in the community:

Publication version

VoR - Version of Record

Publisher

Association for Computing Machinery (ACM)

Title of the publication container

ACM Computing Surveys

First page or article number

1

Last page

41

Volume

56

Issue

9

ISSN

0360-0300

DOI

10.1145/3652508

Fields of Science and Technology (FOS)

computer-and-information-sciences - Computer and information sciences

Publication language (ISO code)

eng - English

Rights type:

Only metadata available