2025 | |
[1] | "Bug Report Analytics for Software Reliability Assessment using Hybrid Swarm – Evolutionary Algorithm", In e-Informatica Software Engineering Journal, vol. 19, no. 1, pp. 250101, 2025.
DOI: , 10.37190/e-Inf250101. Download article (PDF)Get article BibTeX file |
Authors
Sangeeta, Sitender, Rachna Jain, Ankita Bansal
Abstract
Background: With the growing advances in the digital world, software development demands are increasing at an exponential rate. To ensure reliability of the software, high-performance tools for bug report analysis are needed.
Aim: This paper proposes a new ‘Iterative Software Reliability’ model based on one of the most recent Software Development Life Cycle (SDLC) approach.
Method: The proposed iterative failure rate model assumes that new functionality enhancement occurs in each iteration of software development and accordingly design modification is made at each stage of software development. In terms of defects, testing effort, and added functionality, these changing needs in each iteration are reflected in the proposed model using iterative factors. The proposed model has been tested on twelve Eclipse and six JDT software failure datasets. Proposed model parameters have been estimated using a hybrid swarm-evolutionary algorithm.
Results: The proposed model has about 32% and 55% improved efficiency on Eclipse and JDT datasets respectively as compared to other models like Jelinski Moranda Model, Shick-Wolverton Model, Goel Okumotto Imperfect Model etc.
Conclusion: In each analysis done, the proposed model is found to be reaching acceptable performance and could be applied on other software failure datasets for further validation.
Keywords
Software development process, Bug Report Analysis; Optimization; Swarm Evolutionary Algorithms; Software Reliability
References
1. S. Kumar and P. Ranjan, “A phase wise approach for fault identification,” Journal of Information and Optimization Sciences, Vol. 39, No. 1, 2018, pp. 223–237.
2. M. IEEE Standards Coordinating Committee et al., “IEEE standard glossary of software engineering terminology (ieee std 610.12-1990). los alamitos,” CA: IEEE Computer Society, Vol. 169, 1990, p. 132.
3. P. Kapur, H. Pham, A.G. Aggarwal, and G. Kaur, “Two dimensional multi-release software reliability modeling and optimal release planning,” IEEE Transactions on Reliability, Vol. 61, No. 3, 2012, pp. 758–768.
4. C.Y. Huang and M.R. Lyu, “Optimal release time for software systems considering cost, testing-effort, and test efficiency,” IEEE transactions on Reliability, Vol. 54, No. 4, 2005, pp. 583–591.
5. D. Greer and G. Ruhe, “Software release planning: An evolutionary and iterative approach,” Information and software technology, Vol. 46, No. 4, 2004, pp. 243–253.
6. A.L. Goel and K. Okumoto, “Time-dependent error-detection rate model for software reliability and other performance measures,” IEEE transactions on Reliability, Vol. 28, No. 3, 1979, pp. 206–211.
7. H. Pham, System software reliability. Springer Science & Business Media, 2007.
8. K. Sahu and R. Srivastava, “Revisiting software reliability,” Data Management, Analytics and Innovation: Proceedings of ICDMAI 2018, Volume 1, 2019, pp. 221–235.
9. Z. Jelinski and P. Moranda, “Software reliability research,” in Statistical computer performance evaluation. Elsevier, 1972, pp. 465–484.
10. G.J. Schick and R.W. Wolverton, “An analysis of competing software reliability models,” IEEE Transactions on Software Engineering, Vol. 2, 1978, pp. 104–120.
11. J. Xavier, A. Macêdo, R. Matias, and L. Borges, “A survey on research in software reliability engineering in the last decade,” in Proceedings of the 29th Annual ACM Symposium on Applied Computing, 2014, pp. 1190–1191.
12. A.N. Sukert, “An investigation of software reliability models,” in Annual Reliability and Maintainability Symposium, Philadelphia, Pa, 1977, pp. 478–484.
13. P.B. Moranda, “An error detection model for application during software development,” IEEE Transactions on Reliability, Vol. 30, No. 4, 1981, pp. 309–312.
14. B. Littlewood and A. Sofer, “A Bayesian modification to the Jelinski-Moranda software reliability growth model,” Software engineering journal, Vol. 2, No. 2, 1987, pp. 30–41.
15. Z. Luo, P. Cao, G. Tang, and L. Wu, “A modification to the jelinski-moranda software reliability growth model based on cloud model theory,” in Seventh International Conference on Computational Intelligence and Security. IEEE, 2011, pp. 195–198.
16. G. Mahapatra and P. Roy, “Modified Jelinski-Moranda software reliability model with imperfect debugging phenomenon,” International Journal of Computer Applications, Vol. 48, No. 18, 2012, pp. 38–46.
17. X. Zhang, X. Teng, and H. Pham, “Considering fault removal efficiency in software reliability assessment,” IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, Vol. 33, No. 1, 2003, pp. 114–120.
18. J.D. Musa and K. Okumoto, “A logarithmic poisson execution time model for software reliability measurement,” in Proceedings of the 7th international conference on Software engineering. Citeseer, 1984, pp. 230–238.
19. C.Y. Huang, M.R. Lyu, and S.Y. Kuo, “A unified scheme of some nonhomogenous poisson process models for software reliability estimation,” IEEE transactions on software engineering, Vol. 29, No. 3, 2003, pp. 261–269.
20. N. Pavlov, G. Spasov, A. Rahnev, and N. Kyurkchiev, “A new class of Gompertz-type software reliability models,” International Electronic Journal of Pure and Applied Mathematics, Vol. 12, No. 1, 2018, pp. 43–57.
21. P. Roy, G. Mahapatra, and K. Dey, “An NHPP software reliability growth model with imperfect debugging and error generation,” International Journal of Reliability, Quality and Safety Engineering, Vol. 21, No. 02, 2014, p. 1450008.
22. V. Singh, M. Sharma, and H. Pham, “Entropy based software reliability analysis of multi-version open source software,” IEEE Transactions on Software Engineering, Vol. 44, No. 12, 2017, pp. 1207–1223.
23. X. Wei, Y. Dong, X. Li, and W.E. Wong, “Architecture-level hazard analysis using AADL,” Journal of Systems and Software, Vol. 137, 2018, pp. 580–604.
24. V.R. Basil and A.J. Turner, “Iterative enhancement: A practical technique for software development,” IEEE Transactions on Software Engineering, Vol. 4, 1975, pp. 390–396.
25. J. Erickson, K. Lyytinen, and K. Siau, “Agile modeling, agile software development, and extreme programming: The state of research,” Journal of Database Management (JDM), Vol. 16, No. 4, 2005, pp. 88–100.
26. C. Larman and V.R. Basili, “Iterative and incremental developments. A brief history,” Computer, Vol. 36, No. 6, 2003, pp. 47–56.
27. N. Kerzazi and F. Khomh, “Factors impacting software release engineering: A longitudinal study,” in Proc. 2nd Workshop Release Eng, 2014, pp. 1–5.
28. P. Kapur and R. Garg, “Optimal release policies for software systems with testing effort,” International journal of systems science, Vol. 22, No. 9, 1991, pp. 1563–1571.
29. H. Pham and H. Pham, “Software reliability modeling,” System Software Reliability, 2006, pp. 153–177.
30. I.J. Myung, “Tutorial on maximum likelihood estimation,” Journal of mathematical Psychology, Vol. 47, No. 1, 2003, pp. 90–100.
31. M.N. Ab Wahab, S. Nefti-Meziani, and A. Atyabi, “A comprehensive review of swarm optimization algorithms,” PloS one, Vol. 10, No. 5, 2015, p. e0122827.
32. X.S. Yang, Nature-inspired metaheuristic algorithms. Luniver press, 2010.
33. K. Sharma, R. Garg, C. Nagpal, and R.K. Garg, “Selection of optimal software reliability growth models using a distance based approach,” IEEE Transactions on Reliability, Vol. 59, No. 2, 2010, pp. 266–276.
34. M. Xie, Software reliability modelling, Vol. 1. World Scientific, 1991.
35. M. Ohba, “Inflection S-shaped software reliability growth model,” in Stochastic Models in Reliability Theory: Proceedings of a Symposium Held in Nagoya, Japan, April 23–24, 1984. Springer, 1984, pp. 144–162.
36. S. Yamada, M. Ohba, and S. Osaki, “S-shaped reliability growth modeling for software error detection,” IEEE Transactions on reliability, Vol. 32, No. 5, 1983, pp. 475–484.
37. S. Yamada, H. Ohtera, and H. Narihisa, “Software reliability growth models with testing-effort,” IEEE Transactions on Reliability, Vol. 35, No. 1, 1986, pp. 19–23.
38. S. Yamada, H. Ohtera, and M. Ohba, “Testing-domain dependent software reliability models,” Computers & Mathematics with Applications, Vol. 24, No. 1-2, 1992, pp. 79–86.
39. J. Xiang, F. Machida, K. Tadano, and Y. Maeno, “An imperfect fault coverage model with coverage of irrelevant components,” IEEE Transactions on Reliability, Vol. 64, No. 1, 2014, pp. 320–332.
40. P. Kapur and S. Younes, “Modelling an imperfect debugging phenomenon in software reliability,” Microelectronics reliability, Vol. 36, No. 5, 1996, pp. 645–650.
41. B. Littlewood and J.L. Verrall, “A Bayesian reliability growth model for computer software,” Journal of the Royal Statistical Society: Series C (Applied Statistics), Vol. 22, No. 3, 1973, pp. 332–346.
42. T. Mazzuchi and R. Soyer, “A Bayes empirical-Bayes model for software reliability,” IEEE Transactions on Reliability, Vol. 37, No. 2, 1988, pp. 248–254.
43. H. Pham, Springer handbook of engineering statistics. Springer Nature, 2023.
44. B. Littlewood, “Software reliability model for modular program structure,” IEEE Transactions on Reliability, Vol. 28, No. 3, 1979, pp. 241–246.
45. S. Yamada, K. Tokuno, and Y. Kasano, “Quantitative assessment models for software safety/reliability,” Electronics and Communications in Japan (Part II: Electronics), Vol. 81, No. 5, 1998, pp. 33–43.
46. A.L. Goel and K. Okumoto, “A Markovian model for reliability and other performance measures of software systems,” in International Workshop on Managing Requirements Knowledge (MARK). IEEE, 1979, pp. 769–774.
47. J. Shanthikumar, “A general software reliability model for performance prediction,” Microelectronics Reliability, Vol. 21, No. 5, 1981, pp. 671–682.
48. W.S. Jewell, “Bayesian extensions to a basic model of software reliability,” IEEE Transactions on Software engineering, Vol. 12, 1985, pp. 1465–1471.
49. H. Joe and N. Reid, “On the software reliability models of Jelinski-Moranda and Littlewood,” IEEE transactions on reliability, Vol. 34, No. 3, 1985, pp. 216–218.
50. T.F. Ho, W.C. Chan, and C.G. Chung, “A quantum modification to the Jelinski-Moranda software reliability model,” in Proceedings of the 33rd Midwest Symposium on Circuits and Systems. IEEE, 1990, pp. 339–342.
51. P.J. Boland and H. Singh, “A birth-process approach to moranda’s geometric software-reliability model,” IEEE Transactions on Reliability, Vol. 52, No. 2, 2003, pp. 168–174.
52. L.I. Al Turk and E.G. Alsolami, “Jelinski-Moranda software reliability growth model: A brief literature and modification,” International Journal of Software Engineering & Applications (IJSEA), Vol. 7, No. 2, 2016.
53. N. Langberg and N.D. Singpurwalla, “A unification of some software reliability models,” SIAM journal on scientific and statistical computing, Vol. 6, No. 3, 1985, pp. 781–790.
54. Y. Lian, Y. Tang, and Y. Wang, “Objective Bayesian analysis of JM model in software reliability,” Computational Statistics & Data Analysis, Vol. 109, 2017, pp. 199–214.
55. A.G. Aggarwal, P. Kapur, and N. Nijhawan, “A discrete SRGM for multi-release software system with faults of different severity,” International Journal of Operational Research, Vol. 32, No. 2, 2018, pp. 156–168.
56. P. Erto, M. Giorgio, and A. Lepore, “The generalized inflection S-shaped software reliability growth model,” IEEE Transactions on Reliability, Vol. 69, No. 1, 2018, pp. 228–244.
57. D.H. Lee, I.H. Chang, H. Pham, and K.Y. Song, “A software reliability model considering the syntax error in uncertainty environment, optimal release time, and sensitivity analysis,” Applied Sciences, Vol. 8, No. 9, 2018, p. 1483.
58. A.G. Aggarwal, V. Dhaka, N. Nijhawan, and A. Tandon, “Reliability growth analysis for multi-release open source software systems with change point,” System Performance and Management Analytics, 2019, pp. 125–137.
59. R. Gupta, M. Jain, and A. Jain, “Software reliability growth model in distributed environment subject to debugging time lag,” Performance Prediction and Analytics of Fuzzy, Reliability and Queuing Models: Theory and Applications, 2019, pp. 105–118.
60. M. Asraful Haque and N. Ahmad, “A logistic growth model for software reliability estimation considering uncertain factors,” International Journal of Reliability, Quality and Safety Engineering, Vol. 28, No. 05, 2021, p. 2150032.
61. W.D. van Driel, J. Bikker, and M. Tijink, “Prediction of software reliability,” Microelectronics Reliability, Vol. 119, 2021, p. 114074.
62. H. Okamura and T. Dohi, “Application of EM algorithm to NHPP-based software reliability assessment with generalized failure count data,” Mathematics, Vol. 9, No. 9, 2021, p. 985.
63. K. Sahu and R. Srivastava, “Needs and importance of reliability prediction: An industrial perspective,” Information Sciences Letters, Vol. 9, No. 1, 2020, pp. 33–37.
64. K. Kumaresan and P. Ganeshkumar, “Software reliability prediction model with realistic assumption using time series (S) ARIMA model,” Journal of Ambient Intelligence and Humanized Computing, Vol. 11, 2020, pp. 5561–5568.
65. K. Sharma, M. Bala et al., “A quantitative testing effort estimate for reliability assessment of multi release open source software systems,” Journal of Computational and Theoretical Nanoscience, Vol. 16, No. 12, 2019, pp. 5089–5098.
66. S. Malik, K. Sharma, and M. Bala, “Reliability analysis and modeling of green computing based software systems,” Recent Advances in Computer Science and Communications (Formerly: Recent Patents on Computer Science), Vol. 14, No. 4, 2021, pp. 1060–1071.
67. Sangeeta, Sitender, K. Sharma, and M. Bala, “New failure rate model for iterative software development life cycle process,” Automated Software Engineering, Vol. 28, No. 2, 2021, p. 9.
68. X. Liu and N. Xie, “Grey-based approach for estimating software reliability under nonhomogeneous poisson process,” Journal of Systems Engineering and Electronics, Vol. 33, No. 2, 2022, pp. 360–369.
69. B.V. Devi and R.K. Devi, “Software reliability models based on machine learning techniques: A review,” in AIP Conference Proceedings, Vol. 2463. AIP Publishing, 2022.
70. V. Verma, S. Anand, and A.G. Aggarwal, “Optimal time for management review during testing process: ”an” approach using S-curve two-dimensional software reliability growth model,” International Journal of Quality and Reliability Management, 2023.
71. I. Ramadan, H.M. Harb, H. Mousa, and M. Malhat, “Assessment reliability for open-source software using probabilistic models and marine predators algorithm,” International Journal of Computers and Information, Vol. 10, No. 1, 2023, pp. 18–35.
72. V. Pradhan, A. Kumar, and J. Dhar, “Modelling software reliability growth through generalized inflection S-shaped fault reduction factor and optimal release time,” Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, Vol. 236, No. 1, 2022, pp. 18–36.
73. V. Pradhan, A. Kumar, and J. Dhar, “Emerging trends and future directions in software reliability growth modeling,” Engineering reliability and risk assessment, 2023, pp. 131–144.
74. V. Pradhan, J. Dhar, and A. Kumar, “Testing coverage-based software reliability growth model considering uncertainty of operating environment,” Systems Engineering, 2023.
75. J.E. Dennis Jr and R.B. Schnabel, Numerical methods for unconstrained optimization and nonlinear equations. SIAM, 1996.
76. J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of ICNN’95-international conference on neural networks, Vol. 4. IEEE, 1995, pp. 1942–1948.
77. J.H. Holland, “Genetic algorithms,” Scientific american, Vol. 267, No. 1, 1992, pp. 66–73.
78. A. Sheta and J. Al-Salt, “Parameter estimation of software reliability growth models by particle swarm optimization,” management, Vol. 7, 2007, p. 14.
79. R. Malhotra and A. Negi, “Reliability modeling using particle swarm optimization,” International Journal of System Assurance Engineering and Management, Vol. 4, 2013, pp. 275–283.
80. C. Jin and S.W. Jin, “Parameter optimization of software reliability growth model with S-shaped testing-effort function using improved swarm intelligent optimization,” Applied Soft Computing, Vol. 40, 2016, pp. 283–291.
81. S. Mirjalili and S.Z.M. Hashim, “A new hybrid PSOGSA algorithm for function optimization,” in International Conference on Computer and Information Application. IEEE, 2010, pp. 374–377.
82. A. Abraham, R.K. Jatoth, and A. Rajasekhar, “Hybrid differential artificial bee colony algorithm,” Journal of computational and theoretical Nanoscience, Vol. 9, No. 2, 2012, pp. 249–257.
83. S. Mirjalili, G.G. Wang, and L.d.S. Coelho, “Binary optimization using hybrid particle swarm optimization and gravitational search algorithm,” Neural Computing and Applications, Vol. 25, 2014, pp. 1423–1435.
84. F. Liu and Z. Zhou, “An improved QPSO algorithm and its application in the high-dimensional complex problems,” Chemometrics and Intelligent Laboratory Systems, Vol. 132, 2014, pp. 82–90.
85. Y. Li, Y. Wang, and B. Li, “A hybrid artificial bee colony assisted differential evolution algorithm for optimal reactive power flow,” International Journal of Electrical Power & Energy Systems, Vol. 52, 2013, pp. 25–33.
86. S.S. Jadon, R. Tiwari, H. Sharma, and J.C. Bansal, “Hybrid artificial bee colony algorithm with differential evolution,” Applied Soft Computing, Vol. 58, 2017, pp. 11–24.
87. K. Sharma, M. Bala et al., “Magnetic navigation based optimizer: A new optimization algorithm for software reliability model parameter estimation,” J. Adv. Res. Dyn. Control Syst.(14), 2018, pp. 1957–1968.
88. A.K. Tripathi, K. Sharma, and M. Bala, “Military dog based optimizer and its application to fake review,” arXiv preprint arXiv:1909.11890, 2019.
89. K. Sharma, M. Bala et al., “An ecological space based hybrid swarm-evolutionary algorithm for software reliability model parameter estimation,” International Journal of System Assurance Engineering and Management, Vol. 11, No. 1, 2020, pp. 77–92.
90. A. Sharma, R. Chaturvedi, S. Kumar, and U.K. Dwivedi, “Multi-level image thresholding based on kapur and tsallis entropy using firefly algorithm,” Journal of Interdisciplinary Mathematics, Vol. 23, No. 2, 2020, pp. 563–571.
91. M.S. Khan, F. Jabeen, S. Ghouzali, Z. Rehman, S. Naz et al., “Metaheuristic algorithms in optimizing deep neural network model for software effort estimation,” Ieee Access, Vol. 9, 2021, pp. 60 309–60 327.
92. S. Kassaymeh, S. Abdullah, M. Al-Laham, M. Alweshah, M.A. Al-Betar et al., “Salp swarm optimizer for modeling software reliability prediction problems,” Neural Processing Letters, Vol. 53, 2021, pp. 4451–4487.
93. K. Lakra and A. Chug, “Application of metaheuristic techniques in software quality prediction: a systematic mapping study,” International Journal of intelligent engineering informatics, Vol. 9, No. 4, 2021, pp. 355–399.
94. L. Raamesh, S. Jothi, and S. Radhika, “Enhancing software reliability and fault detection using hybrid brainstorm optimization-based lstm model,” IETE Journal of Research, 2022, pp. 1–15.
95. P. Dhavakumar and N. Gopalan, “An efficient parameter optimization of software reliability growth model by using chaotic grey wolf optimization algorithm,” Journal of Ambient Intelligence and Humanized Computing, Vol. 12, 2021, pp. 3177–3188.
96. S. Singh, A. Ashok, M. Kumar, and T.K. Rawat, “Adaptive infinite impulse response system identification using teacher learner based optimization algorithm,” Applied Intelligence, Vol. 49, 2019, pp. 1785–1802.
97. G. Pahuja et al., “Solving reliability redundancy allocation problem using grey wolf optimization algorithm,” in Journal of Physics: Conference Series, Vol. 1706. IOP Publishing, 2020, p. 012155.
98. A. Kaushik, D.K. Tayal, and K. Yadav, “The role of neural networks and metaheuristics in agile software development effort estimation,” in Research anthology on artificial neural network applications. IGI Global, 2022, pp. 306–328.
99. N. Yadav and V. Yadav, “Software reliability prediction and optimization using machine learning algorithms: A review,” Journal of Integrated Science and Technology, Vol. 11, No. 1, 2023, pp. 457–457.