Evaluating Software Quality Through Automated Testing and Predictive Defect Detection Using Machine Learning
DOI:
https://doi.org/10.71465/csb228Keywords:
Software Quality Assurance, Automated Testing, Defect Prediction, Machine Learning, Continuous IntegrationAbstract
Software quality assurance increasingly depends on the ability to combine automated testing with data-driven estimates of defect risk. Conventional test suites reveal failures in executed scenarios but do not necessarily identify which untested changes are most likely to introduce faults. Machine learning models can prioritize code review and testing by learning associations between historical defect outcomes, code structure, change activity, and process characteristics. This narrative review synthesizes established research on software defect prediction and proposes a transparent evaluation framework integrating data preparation, temporal validation, calibrated prediction, risk-based test selection, and continuous monitoring. It distinguishes test effectiveness from model discrimination and emphasizes precision–recall analysis, operational cost, data leakage prevention, and human oversight. A conceptual graph illustrates how testing effort might be redistributed according to predicted risk; it does not represent measured experimental outcomes. The paper argues that machine learning should supplement rather than replace automated tests, and that deployment claims require prospective, project-specific evidence. Limitations include incomplete defect labels, shifting development practices, class imbalance, and uncertain cross-project transferability
References
Software quality assurance increasingly depends on the ability to combine automated testing with data-driven estimates of defect risk. Conventional test suites reveal failures in executed scenarios but do not necessarily identify which untested changes are most likely to introduce faults. Machine learning models can prioritize code review and testing by learning associations between historical defect outcomes, code structure, change activity, and process characteristics. This narrative review synthesizes established research on software defect prediction and proposes a transparent evaluation framework integrating data preparation, temporal validation, calibrated prediction, risk-based test selection, and continuous monitoring. It distinguishes test effectiveness from model discrimination and emphasizes precision–recall analysis, operational cost, data leakage prevention, and human oversight. A conceptual graph illustrates how testing effort might be redistributed according to predicted risk; it does not represent measured experimental outcomes. The paper argues that machine learning should supplement rather than replace automated tests, and that deployment claims require prospective, project-specific evidence. Limitations include incomplete defect labels, shifting development practices, class imbalance, and uncertain cross-project transferability
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Finale Doshi-Velez

This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles published in the Computer Science Bulletin are distributed under an open access license, allowing unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Authors retain copyright and grant the journal the right of first publication. The journal encourages knowledge sharing while maintaining academic integrity and proper attribution.
