e-Informatica Software Engineering Journal Use of Agile Practices in Start-up Companies

Use of Agile Practices in Start-up Companies

[1]Eriks Klotins, Michael Unterkalmsteiner, Panagiota Chatzipetrou, Tony Gorschek, Rafael Prikladnicki, Nirnaya Tripathi and Leandro Bento Pompermaier, "Use of Agile Practices in Start-up Companies", In e-Informatica Software Engineering Journal, vol. 15, no. 1, pp. 47–64, 2021. DOI: 10.37190/e-Inf210103.

Get article (PDF)View article entry (BibTeX)


Eriks Klotins, Michael Unterkalmsteiner, Panagiota Chatzipetrou, Tony Gorschek, Rafael Prikladnicki, Nirnaya Tripathi, Leandro Bento Pompermaier


Context: Software start-ups have shown their ability to develop and launch innovative software products and services. Small, motivated teams and uncertain project scope makes start-ups good candidates for adopting Agile practices.

Objective: We explore how start-ups use Agile practices and what effects can be associated with the use of those practices.

Method We use a case survey to analyze 84 start-up cases and 56 Agile practices. We apply statistical methods to test for statistically significant associations between the use of Agile practices, team, and product factors.

Results: Our results suggest that development of the backlog, use of version control, code refactoring, and development of user stories are the most frequently reported practices. We identify 22 associations between the use of Agile practices, team, and product factors. The use of Agile practices is associated with effects on source code and overall product quality. A teams’ positive or negative attitude towards best engineering practices is a significant indicator for either adoption or rejection of certain Agile practices. To explore the relationships in our findings, we set forth a number of propositions that can be investigated in future research.

Conclusions: We conclude that start-ups use Agile practices, however without following any specific methodology. We identify the opportunity for more fine-grained studies into the adoption and effects of individual Agile practices. Start-up practitioners could benefit from Agile practices in terms of better overall quality, tighter control over team performance, and resource utilization.


Agile practices, start-up companies


1. C. Giardino, S.S. Bajwa, and X. Wang, “Key challenges in early-stage software startups,” in Agile Processes, in Software Engineering, and Extreme Programming , Vol. 212, 2015, pp. 52–63.

2. S. Blank, “Why the lean start up changes everything,” Harvard Business Review , Vol. 91, No. 5, 2013, p. 64.

3. C. Giardino, M. Unterkalmsteiner, N. Paternoster, T. Gorschek, and P. Abrahamsson, “What do we know about software development in startups?” IEEE Software , Vol. 31, No. 5, 2014, pp. 28–32.

4. N. Paternoster, C. Giardino, M. Unterkalmsteiner, T. Gorschek, and P. Abrahamsson, “Software development in startup companies: A systematic mapping study,” Information and Software Technology , Vol. 56, No. 10, 2014, pp. 1200–1218.

5. E. Klotins, M. Unterkalmsteiner, and T. Gorschek, “Software engineering in start-up companies: An analysis of 88 experience reports,” Empirical Software Engineering , Vol. 24, No. 1, 2019, pp. 68–102.

6. A. Yau and C. Murphy, “Is a rigorous agile methodology the best development strategy for small scale tech startups?” University of Pennsylvania Department of Computer and Information Science, Tech. Rep., 2013.

7. G. Carmine, N. Paternoster, M. Unterkalmsteiner, T. Gorschek, and P. Abrahamsson, “Software development in startup companies: The greenfield startup model,” IEEE Transactions on Software Engineering , Vol. 42, No. 6, 2016, p. 233.

8. J. Pantiuchina, M. Mondini, D. Khanna, X. Wang, and P. Abrahamsson, “Are software startups applying agile practices? the state of the practice from a large survey,” in International Conference on Agile Software Development . Springer, Cham, 2017, pp. 167–183.

9. E. Klotins, M. Unterkalmsteiner, P. Chatzipetrou, T. Gorschek, R. Prikladniki, N. Tripathi, and L. Pompermaier, “A progression model of software engineering goals, challenges, and practices in start-ups,” IEEE Transactions on Software Engineering , 2019.

10. PitchBook Data, Inc., “European middle market report 2h 2015,” Tech. Rep., 2015.

11. PitchBook Data, Inc., “U.S. middle market report Q4 2015,” Tech. Rep., 2015.

12. E. Klotins, “Software start-ups through an empirical lens: are start-ups snowflakes?” in 1st International Workshop on Software-Intensive Business: Start-Ups, Ecosystems and Platforms, SiBW 2018, Espoo, Finland, 3 December 2018 . CEUR-WS, 2018.

13. S.M. Sutton, E.C. Cubed, and M. Andretti, “The role of process in a software start-up,” IEEE Software , Vol. 17, No. 4, 2000, pp. 33–39.

14. K. Beck, M. Beedle, A. Van Bennekum, A. Cockburn, W. Cunningham, M. Fowler, J. Grenning, J. Highsmith, A. Hunt, R. Jeffries et al., “Manifesto for agile software development,” 2001.

15. L. Rising and N.S. Janoff, “The Scrum software development process for small teams,” IEEE Software , No. August, 2000, pp. 26–32.

16. V.E. Jyothi and K.N. Rao, “Effective implementation of agile practices-incoordination with lean kanban,” International Journal on Computer Science and Engineering , Vol. 4, No. 1, 2012, p. 87.

17. P. Diebold and M. Dahlem, “Agile practices in practice: a mapping study,” in Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering . ACM, 2014, p. 30.

18. S. Jalali and C. Wohlin, “Global software engineering and agile practices: a systematic review,” Journal of software: Evolution and Process , Vol. 24, No. 6, 2012, pp. 643–659.

19. T. Chow and D.B. Cao, “A survey study of critical success factors in agile software projects,” Journal of Systems and Software , Vol. 81, No. 6, 2008, pp. 961–971.

20. S. Misra, V. Kumar, U. Kumar, K. Fantazy, and M. Akhter, “Agile software development practices: evolution, principles, and criticisms,” International Journal of Quality and Reliability Management , Vol. 29, No. 9, 2012, pp. 972–980.

21. A. Solinski and K. Petersen, “Prioritizing agile benefits and limitations in relation to practice usage,” Software Quality Journal , Vol. 24, No. 2, 2016, pp. 447–482.

22. E. Mkpojiogu, N. Hashim, A. Al-Sakkaf, and A. Hussain, “Software startups: Motivations for agile adoption,” International Journal of Innovative Technology and Exploring Engineering , Vol. 8, No. 8S, 2019, pp. 454–459.

23. R. Souza, L. Rocha, F. Silva, and I. Machado, “Investigating agile practices in software startups,” in Proceedings of the XXXIII Brazilian Symposium on Software Engineering , 2019, pp. 317–321.

24. Agile Alliance, “Agile glossary,” https://www.agilealliance.org/agile101/agile-glossary/ , 2018, [Online; accessed 20-April-2018].

25. L. Layman, L. Williams, and L. Cunningham, “Exploring extreme programming in context: an industrial case study,” in Agile Development Conference . IEEE, 2004, pp. 32–41.

26. S. Ilieva, P. Ivanov, and E. Stefanova, “Analyses of an agile methodology implementation,” in Proceedings. 30th Euromicro Conference . IEEE, 2004, pp. 326–333.

27. B. Kitchenham and S.L. Pfleeger, “Software quality: the elusive target [special issues section],” IEEE Software , Vol. 13, No. 1, 1996, pp. 12–21.

28. E. Tom, A. Aurum, and R. Vidgen, “An exploration of technical debt,” Journal of Systems and Software , Vol. 86, No. 6, 2013, pp. 1498–1516.

29. G. Lucassen, F. Dalpiaz, J.M.E. van der Werf, and S. Brinkkemper, “Forging high-quality user stories: towards a discipline for agile requirements,” in IEEE 23rd international requirements engineering conference (RE) . IEEE, 2015, pp. 126–135.

30. R. Khaled, P. Barr, J. Noble, and R. Biddle, “System metaphor in extreme programming: A semiotic approach,” in 7th International Workshop on Organizational Semiotics . Citeseer, 2004.

31. E.F. Collins and V.F. de Lucena, “Software test automation practices in agile development environment: An industry experience report,” in 7th International Workshop on Automation of Software Test (AST) . IEEE, 2012, pp. 57–63.

32. R. Moser, P. Abrahamsson, W. Pedrycz, A. Sillitti, and G. Succi, “A case study on the impact of refactoring on quality and productivity in an agile team,” in IFIP Central and East European Conference on Software Engineering Techniques . Springer, 2007, pp. 252–266.

33. B. Selic, “Agile documentation, anyone?” IEEE Software , Vol. 26, No. 6, 2009.

34. F. Palomba, G. Bavota, M. Di Penta, R. Oliveto, and A. De Lucia, “Do they really smell bad? A study on developers’ perception of bad code smells,” in IEEE International Conference on Software Maintenance and Evolution . IEEE, 2014, pp. 101–110.

35. M. Mantyla, J. Vanhanen, and C. Lassenius, “A taxonomy and an initial empirical study of bad smells in code,” in International Conference on Software Maintenance , 2003, pp. 381–384.

36. T. Dybå and T. Dingsøyr, “Empirical studies of agile software development: A systematic review,” Information and Software Technology , Vol. 50, No. 9-10, 2008, pp. 833–859.

37. E. Klotins, “Using the case survey method to explore engineering practices in software start-ups,” in Proceedings of the 1st International Workshop on Software Engineering for Startups . IEEE Press, 2017, pp. 24–26.

38. R. Larsson, “Case survey methodology: Quantitative analysis of patterns across case studies,” Academy of Management Journal , Vol. 36, No. 6, 1993, pp. 1515–1546.

39. A.C. Hope, “A simplified Monte Carlo significance test procedure,” Journal of the Royal Statistical Society. Series B (Methodological) , 1968, pp. 582–598.

40. J. Cohen, Statistical power analysis for the behaviour sciences . Lawrence Erlbaum Associates, 1988.

41. A. Agresti, An introduction to categorical data analysis . Wiley New York, 1996, Vol. 135.

42. P. Runeson, M. Höst, A. Rainer, and B. Regnell, Case study research in software engineering . John Wiley and Sons, Inc., 2012.

43. W.W. Daniel, “Spearman rank correlation coefficient,” Applied Nonparametric Statistics , 1990, pp. 358–365.

44. M. Crowne, “Why software product startups fail and what to do about it,” in Engineering Management Conference . Cambridge, UK: IEEE, 2002, pp. 338–343.

45. B. De Alwis and J. Sillito, “Why are software projects moving from centralized to decentralized version control systems?” in ICSE Workshop on Cooperative and Human Aspects on Software Engineering . IEEE, 2009, pp. 36–39.

46. E. Daka and G. Fraser, “A survey on unit testing practices and problems,” in IEEE 25th International Symposium on Software Reliability Engineering . IEEE, 2014, pp. 201–211.

47. L. Gren, R. Torkar, and R. Feldt, “The prospects of a quantitative measurement of agility: A validation study on an agile maturity model,” Journal of Systems and Software , Vol. 107, 2015, pp. 38–49.

48. M. Ozer and D. Vogel, “Contextualized relationship between knowledge sharing and performance in software development,” Journal of Management Information Systems , Vol. 32, No. 2, 2015, pp. 134–161.

49. C. Gralha, D. Damian, A.I.T. Wasserman, M. Goulão, and J. Araújo, “The evolution of requirements practices in software startups,” in Proceedings of the 40th International Conference on Software Engineering . ACM, 2018, pp. 823–833.

©2015 e-Informatyka.pl, All rights reserved.

Built on WordPress Theme: Mediaphase Lite by ThemeFurnace.