Nicole Forsgrenperson

devopsresearchdoraempirical-methods
2 min read · Edit on Pyrite

Nicole Forsgren's contribution to the DevOps movement is methodological: she brought rigorous empirical research methods to a field that had previously operated on practitioner intuition and anecdote. Her work transformed DevOps from an advocacy movement into one with an evidence base.

Forsgren holds a PhD and her research background distinguishes her from other DevOps figures, most of whom came from operations or development practice. She founded DORA (DevOps Research and Assessment) with jez-humble and gene-kim, creating the institutional infrastructure for sustained empirical research into software delivery.

The state-of-devops-report-series is the primary output of this work. Beginning in partnership with Puppet Labs in 2014 and eventually running independently through Google, the annual survey accumulated responses from over 23,000 practitioners across 4 years of Forsgren-led research. The survey design used structural equation modeling — a psychometrics technique — to establish that the relationships between DevOps practices and organizational performance were causal, not merely correlational. This was methodologically significant: the field had many claims about what "works" but few that could withstand that level of scrutiny.

The dora-four-key-metrics (deployment frequency, lead time for changes, change failure rate, mean time to restore) emerged from this research as operationalizable measures of software delivery performance. These four metrics have become the standard by which engineering organizations evaluate their delivery capability — a direct consequence of Forsgren's research program.

accelerate-book (2018, with Humble and Kim) is the accessible presentation of these findings. It bridges the academic rigor of the underlying research with a practitioner-facing narrative, and it established that high software delivery performance correlates with organizational performance (commercial and non-commercial outcomes), not merely with technical efficiency. This connection — that delivery performance is a business outcome predictor — was the finding that gave DevOps traction in executive conversations.

Google acquired DORA in December 2018, moving the research program inside a major technology company. This gave the program resources but also changed its institutional character. After the Google acquisition, Forsgren moved to VP of Research and Strategy at GitHub (a Microsoft property), maintaining a position at the intersection of research and industry.

Her intellectual lineage runs through organizational psychology and information systems research — disciplines with established methods for studying sociotechnical systems — applied to software engineering. She connects the DevOps movement to the broader tradition of software engineering measurement (the Coding War Games lineage, Boehm's COCOMO, the SEI CMMI tradition) while rejecting the compliance orientation of earlier measurement frameworks in favor of learning and improvement.