Coding War Games Studyevent

flowproductivitycoding-war-gamesempirical-researchoffice-environment
1984-01-01 · 2 min read · Edit on Pyrite

The Coding War Games study was a multi-year empirical research project conducted by DeMarco and timothy-lister through the atlantic-systems-guild consulting network, beginning in approximately 1984. It is the primary empirical foundation of peopleware and the source of the coding-war-games dataset that established the office-environment-effect and flow-and-interruption-cost as central variables in programmer productivity.

Design and methodology

The Coding War Games were structured as a benchmarking competition: professional programmers at client organizations were given identical programming tasks — problems of defined scope and complexity — and asked to complete them under their normal working conditions. Participants worked in their own offices, at their own hours, using their own tools and languages. The results were collected and compared across participants.

The study accumulated data from hundreds of programmers at dozens of organizations over multiple years. The design was intentionally naturalistic: by having programmers work under their actual conditions rather than in a controlled laboratory environment, the study captured real-world variance in productivity rather than variance in abstract algorithmic performance. This methodological choice was what made the office-environment-effect finding possible: if everyone had worked in the same room under the same conditions, the environmental variable would have been controlled out of existence.

Key findings

The study's most important finding was that the variance in programmer performance — ratios of 10:1 between top and bottom performers were documented — did not correlate with years of experience, salary, or programming language. It correlated with workspace quality. The single most important workspace variable was the ability to achieve and sustain uninterrupted concentration — what mihaly-csikszentmihalyi's flow theory describes as the precondition for flow-and-interruption-cost-minimizing productive work.

The finding that the best performers clustered in organizations with the best working environments — not merely that individuals differed — was particularly significant. It meant that the office-environment-effect was an organizational variable that management could affect, not merely an individual characteristic to be screened for in hiring.

Relationship to the peopleware argument

The coding-war-games data is the empirical spine of peopleware. The book's argument — the peopleware-thesis that software failures are predominantly sociological — rests on this study as its primary evidence. Without the Coding War Games data, peopleware would be a set of observations and arguments without systematic empirical grounding; with it, DeMarco and Lister could point to actual numbers from actual programmers in actual organizations.

The study also supported the team-jell argument: programmers who worked in high-jell teams showed performance multipliers consistent with the team-level benefits that Lister attributed to stable, autonomous team structures. The individual-level environment data and the team-level cohesion data pointed in the same direction.

Institutional context

The Coding War Games study was possible because of the atlantic-systems-guild's access to multiple client organizations. As consultants working across dozens of companies, DeMarco and Lister could recruit participants and administer the study at scale that an academic researcher without an industrial consulting network could not have achieved. The study is a product of the Guild's specific institutional form: a research-and-consulting hybrid that combined academic ambition with practitioner access.

The approximate date of 1984 marks the beginning of the study's data collection; the study ran through multiple years and the data informed both the peopleware-publication in 1987 and subsequent editions of the book. It sits at the transition between the structured-methods-era (in which the institutional infrastructure was built) and the peopleware-breakthrough-era (in which the findings were published and disseminated).