The Relation of Test-Related Factors to Software Quality: A Case Study on Apache Systems

Risk Conference Proceedings โ€บ The Relation of Test-Related Factors to Software Quality: A Case Study on Apache Systems
Research

The Relation of Test-Related Factors to Software Quality: A Case Study on Apache Systems

By Fabiano Pecorelli, Fabio Palomba & Andrea De Lucia ยท September 14, 2026
Abstract

Testing represents a crucial activity to ensure software quality. Recent studies have shown that test-related factors (e.g., code coverage) can be reliable predictors of software code quality, as measured by post-release defects. While these studies provided initial compelling evidence on the relation between tests and post-release defects, they considered different test-related factors separately: as a consequence, there is still a lack of knowledge of whether these factors are still good predictors when considering all together. In this paper, we propose a comprehensive case study on how test-related factors relate to production code quality in Apache systems. We first investigated how the presence of tests relates to post-release defects; then, we analyzed the role played by the test-related factors previously shown as significantly related to post-release defects. The key findings of the study show that, when controlling for other metrics (e.g., size of the production class), test-related factors have a limited connection to post-release defects.

Publication Details
Type Research
Volume 26
Issue No. 18
Published Sep 14, 2026
Open Access ๐Ÿ‘ View Paper โ†“ Download Paper
โ† Back to Proceedings