|||"Knowledge Management in Software Testing: A Systematic Snowball Literature Review", In e-Informatica Software Engineering Journal, vol. 12, no. 1, pp. 51–78, 2018.
DOI: , 10.5277/e-Inf180103.|
Download article (PDF)Get article BibTeX file
Krzysztof Wnuk, Thrinay Garrepalli
Description : Software testing benefits from the usage of Knowledge Management (KM) methods and principles. Thus, there is a need to adopt KM to the software testing core processes and attain the benefits that it provides in terms of cost, quality, etc.
Aim : To investigate the usage and implementation of KM for software testing. The major objectives include 1. To identify various software testing aspects that receive more attention while applying KM. 2. To analyse multiple software testing techniques, i.e. test design, test execution and test result analysis and highlight KM involvement in these. 3. To gather challenges faced by industry due to the lack of KM initiatives in software testing.
Method : A Systematic Literature Review (SLR) was conducted utilizing the guidelines for snowballing reviews by Wohlin. The identified studies were analysed in relation to their rigor and relevance to assess the quality of the results.
Results : The initial resulting set provided 4832 studies. From these, 35 peer-reviewed papers were chosen among which 31 are primary, and 4 are secondary studies. The literature review results indicated nine testing aspects being in focus when applying KM within various adaptation contexts and some benefits from KM application. Several challenges were identified, e.g., improper selection and application of better-suited techniques, a low reuse rate of software testing knowledge, barriers in software testing knowledge transfer, no possibility to quickly achieve the most optimum distribution of human resources during testing, etc.
Conclusions : The study brings supporting evidence that the application of KM in software testing is necessary, e.g., to increase test effectiveness, select and apply testing techniques. The study outlines the testing aspects and testing techniques that benefit their users.
KM, software testing, knowledge, systematic literature review
 E.F. de Souza, R. de Almeida Falbo, and N.L. Vijaykumar, “Knowledge management initiatives in software testing: A mapping study,” Information and Software Technology, Vol. 57, 2015, pp. 378 – 391. [Online]. http://www.sciencedirect.com/science/article/pii/S0950584914001335
 J. Andrade, J. Ares, M.A. Martínez, J. Pazos, S. Rodríguez, J. Romera, and S. Suárez, “An architectural model for software testing lesson learned systems,” Information and Software Technology, Vol. 55, No. 1, 2013, pp. 18–34.
 Y. Liu, J. Wu, X. Liu, and G. Gu, “Investigation of knowledge management methods in software testing process,” in International Conference on Information Technology and Computer Science, Vol. 2. IEEE, 2009, pp. 90–94.
 R. Abdullah, Z.D. Eri, and A.M. Talib, “A model of knowledge management system in managing knowledge of software testing environment,” in 5th Malaysian Conference in Software Engineering (MySEC). IEEE, 2011, pp. 229–233.
 L. Xu-Xiang and W.N. Zhang, “The PDCA-based software testing improvement framework,” in International Conference on Apperceiving Computing and Intelligence Analysis (ICACIA. IEEE, 2010, pp. 490–494.
 O.K. Wei and T.M. Ying, “Knowledge management approach in mobile software system testing,” in IEEE International Conference on Industrial Engineering and Engineering Management. IEEE, 2007, pp. 2120–2123.
 T. Abdou and P. Kamthan, “A knowledge management approach for testing open source software systems,” in International Performance Computing and Communications Conference (IPCCC). IEEE, 2014, pp. 1–2.
 J. Sirathienchai, P. Sophatsathit, and D. Dechawatanapaisal, “Simulation-based evaluation for the impact of personnel capability on software testing performance,” Journal of Software Engineering and Applications, Vol. 5, No. 08, 2012, p. 545.
 V.H. Nasser, W. Du, and D. MacIsaac, “An ontology-based software test generation framework.” in The 22nd International Conference on Software Engineering and Knowledge Engineering, SEKE, 2010, pp. 192–197.
 H. Li, F. Chen, H. Yang, H. Guo, W.C.C. Chu, and Y. Yang, “An ontology-based approach for gui testing,” in 33rd Annual IEEE International Computer Software and Applications Conference, Vol. 1. IEEE, 2009, pp. 632–633.
 E.F. Barbosa, E.Y. Nakagawa, and J.C. Maldonado, “Towards the establishment of an ontology of software testing.” in International Conference on Software Engineering & Knowledge Engineering, 2006, pp. 522–525.
 A.C.C. Natali, A.R.C. da Rocha, G.H. Travassos, and P.G. Mian, “Integrating verification and validation techniques knowledge into software engineering environments,” Proceedings of 4as Jornadas Ibeoamericanas de Ingeniería del Software e Ingeniería del Conocimiento, JIISIC, Vol. 4, 2004, pp. 419–430.
 R. Jain and S. Richardson, “Knowledge partitioning and knowledge transfer mechanisms in software testing: An empirical investigation,” in Proceedings of the 1st Workshop on Advances and Innovations in Systems Testing, 2007.
 X. Liu, G. Gu, L. Yongpu, and W. Ji, “Research and application of knowledge management model oriented software testing process,” in 11th Joint International Conference on Information Sciences. Atlantis Press, 2008.
 O. Taipale, K. Karhu, and K. Smolander, “Observing software testing practice from the viewpoint of organizations and knowledge management,” in First International Symposium on Empirical Software Engineering and Measurement. IEEE, 2007, pp. 21–30.
 L. Xue-Mei, G. Guochang, L. Yong-Po, and W. Ji, “Research and implementation of knowledge management methods in software testing process,” in WRI World Congress on Computer Science and Information Engineering, Vol. 7. IEEE, 2009, pp. 739–743.
 B.A. Kitchenham, T. Dyba, and M. Jorgensen, “Evidence-based software engineering,” in Proceedings of the 26th International Conference on Software Engineering. IEEE Computer Society, 2004, pp. 273–281.
 C. Wohlin, “Guidelines for snowballing in systematic literature studies and a replication in software engineering,” in Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, ser. EASE ’14. New York, NY, USA: ACM, 2014, pp. 38:1–38:10. [Online]. http://doi.acm.org/10.1145/2601248.2601268
 B. Kitchenham, O.P. Brereton, D. Budgen, M. Turner, J. Bailey, and S. Linkman, “Systematic literature reviews in software engineering – a systematic literature review,” Information and software technology, Vol. 51, No. 1, 2009, pp. 7–15.
 B. Kitchenham, R. Pretorius, D. Budgen, O.P. Brereton, M. Turner, M. Niazi, and S. Linkman, “Systematic literature reviews in software engineering – a tertiary study,” Information and Software Technology, Vol. 52, No. 8, 2010, pp. 792–805.
 M. Dixon-Woods, S. Agarwal, D. Jones, B. Young, and A. Sutton, “Synthesising qualitative and quantitative evidence: a review of possible methods,” Journal of Health Services Research & Policy, Vol. 10, No. 1, 2005, pp. 45–53.
 D. Koznov, V. Malinov, E. Sokhransky, and M. Novikova, “A knowledge management approach for industrial model-based testing,” in Proceedings of the International Conference on Knowledge Management and Information Sharing, 2009, pp. 200–205.
 M. Rodgers, A. Sowden, M. Petticrew, L. Arai, H. Roberts, N. Britten, and J. Popay, “Testing methodological guidance on the conduct of narrative synthesis in systematic reviews: effectiveness of interventions to promote smoke alarm ownership and function,” Evaluation, Vol. 15, No. 1, 2009, pp. 49–73.
 R. Wieringa, N. Maiden, N. Mead, and C. Rolland, “Requirements engineering paper classification and evaluation criteria: A proposal and a discussion,” Requirements Engineering, Vol. 11, No. 1, 2006, pp. 102–107.
 R. de Almeida Falbo, “Experiences in using a method for building domain ontologies,” in The 16th International Conference on Software Engineering and Knowledge Engineering, SEKE, 2004, pp. 474–477.
 M. Cataldo, P.A. Wagstrom, J.D. Herbsleb, and K.M. Carley, “Identification of coordination requirements: implications for the design of collaboration and awareness tools,” in Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work. ACM, 2006, pp. 353–362.
 E.F. de Souza, R. de Almeida Falbo, and N.L. Vijaykumar, “Knowledge management applied to software testing: A systematic mapping,” in The 25th International Conference on Software Engineering and Knowledge Engineering, SEKE, Boston, USA, 2013, pp. 562–567.
 J. Itkonen, M.V. Mantyla, and C. Lassenius, “How do testers do it? An exploratory study on manual testing practices,” in Proceedings of the 3rd International Symposium on Empirical Software Engineering and Measurement. IEEE Computer Society, 2009, pp. 494–497.
 A. Freitas and R. Vieira, “An ontology for guiding performance testing,” in Proceedings of the 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT), Vol. 1. IEEE Computer Society, 2014, pp. 400–407.
 C. Kerkhof, J. van den Ende, and I. Bogenrieder, “Knowledge management in the professional organization: a model with application to CMG software testing,” Knowledge and Process Management, Vol. 10, No. 2, 2003, pp. 77–84.
 S. Vegas, N. Juristo, and V.R. Basili, “Maturing software engineering knowledge through classifications: A case study on unit testing techniques,” IEEE Transactions on Software Engineering, Vol. 35, No. 4, 2009, pp. 551–565.
 E.F. de Souza, R. de Almeida Falbo, and N.L. Vijaykumar, “Using ontology patterns for building a reference software testing ontology,” in 17th IEEE International Enterprise Distributed Object Computing Conference Workshops (EDOCW). IEEE, 2013, pp. 21–30.
 H. Li, H. Guo, F. Chen, H. Yang, and Y. Yang, “Using ontology to generate test cases for GUI testing,” International Journal of Computer Applications in Technology, Vol. 42, No. 2-3, 2011, pp. 213–224.