Abstract
Virtualization of resources in cloud computing has enabled developers to commission and recommission resources at will and on demand. This virtualization is a coin with two sides. On one hand, the flexibility in managing virtual resources has enabled developers to efficiently manage their costs; they can easily remove unnecessary resources or add resources temporarily when the demand increases. On the other hand, the volatility of such environment and the velocity with which changes can occur may have a greater impact on the economic position of a stakeholder and the business balance of the overall ecosystem. In this work, we recognise the business ecosystem of cloud computing as an economy of scale and explore the effect of this fact on decisions concerning scaling the infrastructure of web applications to account for fluctuations in demand. The goal is to reveal and formalize opportunities for economically optimal scaling that takes into account not only the cost of infrastructure but also the revenue from service delivery and eventually the profit of the service provider. The end product is a scaling mechanism that makes decisions based on both performance and economic criteria and takes adaptive actions to optimize both performance and profitability for the system.
- Tarek F. Abdelzaher, John A. Stankovic, Chenyang Lu, Ronghua Zhang, and Ying Lu. 2003. Feedback performance control in software services. IEEE Contr. Syst. 23, 3 (June 2003), 74--90. DOI:http://dx.doi.org/10.1109/MCS.2003.1200252. Google Scholar
Cross Ref
- Abdullah M. Alshanqiti, Reiko Heckel, and Tamim Khan. 2013. Learning minimal and maximal rules from observations of graph transformations. Electron. Commun. EASST 58 (2013).Google Scholar
- Amazon. 2017. Autoscaling. Retrieved from https://aws.amazon.com/autoscaling/.Google Scholar
- Michael Armbrust, Armando Fox, Rean Griffith, Anthony D. Joseph, Randy Katz, Andy Konwinski, Gunho Lee, David Patterson, Ariel Rabkin, Ion Stoica, and others. 2010. A view of cloud computing. Commun. ACM 53, 4 (2010), 50--58. Google Scholar
Digital Library
- Karl Johan Aström and Richard M. Murray. 2010. Feedback Systems: An Introduction for Scientists and Engineers. Princeton University Press.Google Scholar
- Armin Balalaie, Abbas Heydarnoori, and Pooyan Jamshidi. 2016. Microservices architecture enables devops: Migration to a cloud-native architecture. IEEE Softw. 33, 3 (2016), 42--52. Google Scholar
Digital Library
- Cornel Barna, Marios Fokaefs, Marin Litoiu, Mark Shtern, and Joe Wigglesworth. 2016. Cloud adaptation with control theory in industrial clouds. In Proceedings of the IEEE International Conference on Cloud Engineering Workshop (IC2EW’16). IEEE, 231--238. Google Scholar
Cross Ref
- Cornel Barna, Hamoun Ghanbari, Marin Litoiu, and Mark Shtern. 2015. Hogna: A platform for self-adaptive applications in cloud environments. In Proceedings of the IEEE/ACM 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS’15). 83--87. Google Scholar
Digital Library
- Cornel Barna, Hamzeh Khazaei, Marios Fokaefs, and Marin Litoiu. 2017. Delivering elastic containerized cloud applications to enable devops. In Proceedings of the 12th International Symposium on Software Engineering for Adaptive and Self-Managing Systems. ACM. Google Scholar
Digital Library
- Cornel Barna, Marin Litoiu, and Hamoun Ghanbari. 2011. Autonomic load-testing framework. In Proceedings of the 8th ACM International Conference on Autonomic Computing. ACM, 91--100. Google Scholar
Digital Library
- Cornel Barna, Mark Shtern, Michael Smit, Vassilios Tzerpos, and Marin Litoiu. 2014. Mitigating DoS attacks using performance model-driven adaptive algorithms. ACM Trans. Auton. Adapt. Syst. 9, 1, Article 3 (March 2014), 3:1--3:26 pages.Google Scholar
Digital Library
- Ali Basiri, Niosha Behnam, Ruud de Rooij, Lorin Hochstein, Luke Kosewski, Justin Reynolds, and Casey Rosenthal. 2016. Chaos engineering. IEEE Softw. 33, 3 (2016), 35--41. Google Scholar
Digital Library
- Len Bass, Ingo Weber, and Liming Zhu. 2015. DevOps: A Software Architect’s Perspective. Addison-Wesley Professional.Google Scholar
- V. H. Blackman. 1919. The compound interest law and plant growth. Ann. Botany 33, 131 (1919), 353--360. Google Scholar
Cross Ref
- Jan Bosch and Helena Holmström Olsson. 2016. Data-driven continuous evolution of smart systems. In Proceedings of the 11th International Symposium on Software Engineering for Adaptive and Self-Managing Systems. ACM, 28--34. Google Scholar
Digital Library
- Junliang Chen, Chen Wang, Bing Bing Zhou, Lei Sun, Young Choon Lee, and Albert Y. Zomaya. 2011. Tradeoffs between profit and customer satisfaction for service provisioning in the cloud. In Proceedings of the 20th International Symposium on High Performance Distributed Computing. ACM, 229--238. Google Scholar
Digital Library
- Mayank Dave and Y. Singh Shishodia. 2014. Cloud economics: Vital force in structuring the future of cloud computing. In Proceedings of the International Conference on Computing for Sustainable Global Development (INDIACOM’14). IEEE, 61--66.Google Scholar
- Marios D. Dikaiakos, Dimitrios Katsaros, Pankaj Mehra, George Pallis, and Athena Vakali. 2009. Cloud computing: Distributed internet computing for IT and scientific research. IEEE Internet Comput. 13, 5 (2009), 10--13. Google Scholar
Digital Library
- Hakan Erdogmus. 2009. Cloud computing: Does nirvana hide behind the nebula? IEEE Softw. 26, 2 (2009), 4--6. Google Scholar
Digital Library
- Antonio Filieri, Henry Hoffmann, and Martina Maggio. 2014. Automated design of self-adaptive software with control-theoretical formal guarantees. In Proceedings of the 36th International Conference on Software Engineering (ICSE’14). ACM, New York, NY, 299--310. DOI:http://dx.doi.org/10.1145/2568225.2568272 Google Scholar
Digital Library
- Antonio Filieri, Henry Hoffmann, and Martina Maggio. 2015. Automated multi-objective control for self-adaptive software design. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering (ESEC/FSE’15). ACM, New York, NY, 13--24. DOI:http://dx.doi.org/10.1145/2786805.2786833 Google Scholar
Digital Library
- Antonio Filieri, Martina Maggio, Konstantinos Angelopoulos, Nicolás Dippolito, Ilias Gerostathopoulos, Andreas Berndt Hempel, Henry Hoffmann, Pooyan Jamshidi, Evangelia Kalyvianaki, Cristian Klein, and others. 2017. Control strategies for self-adaptive software systems. ACM Trans. Auton. Adapt. Syst. 11, 4 (2017), 24. Google Scholar
Digital Library
- Marios Fokaefs, Cornel Barna, and Marin Litoiu. 2016. An economic model for scaling cloud applications. In Proceedings of the IEEE 9th International Conference on Cloud Computing (CLOUD’16). IEEE, 464--471. Google Scholar
Cross Ref
- Marios Fokaefs, Cornel Barna, and Marin Litoiu. 2016. Economics-driven resource scalability on the cloud. In Proceedings of the 11th International Symposium on Software Engineering for Adaptive and Self-Managing Systems. ACM, 129--139. Google Scholar
Digital Library
- Marios Fokaefs, Cornel Barna, Rodrigo Veleda, Marin Litoiu, Joe Wigglesworth, and Radu Mateescu. 2016. Enabling devops for containerized data-intensive applications: An exploratory study. In Proceedings of the 26th Annual International Conference on Computer Science and Software Engineering. IBM Corp., 138--148.Google Scholar
Digital Library
- Ian Gergin, Bradley Simmons, and Marin Litoiu. 2014. A decentralized autonomic architecture for performance control in the cloud. In Proceedings of the IEEE International Conference on Cloud Engineering (IC2E’14). IEEE, 574--579. Google Scholar
Digital Library
- Hamoun Ghanbari, Marin Litoiu, Przemyslaw Pawluk, and Cornel Barna. 2014. Replica placement in cloud through simple stochastic model predictive control. In Proceedings of the IEEE 7th International Conference on Cloud Computing (CLOUD’14). IEEE, 80--87. Google Scholar
Digital Library
- Robert L. Grossman. 2009. The case for cloud computing. IT Profess. 11, 2 (2009), 23--27. Google Scholar
Digital Library
- Rui Han, Li Guo, Moustafa M. Ghanem, and Yike Guo. 2012. Lightweight resource scaling for cloud applications. In Proceedings of the 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID’12). IEEE, 644--651. Google Scholar
Digital Library
- Michael Hüttermann. 2012. DevOps for Developers. Apress.Google Scholar
- IBM. 2005. An Architectural Blueprint for Autonomic Computing. Technical Report. IBM.Google Scholar
- Joseph Idziorek and Mark Tannian. 2011. Exploiting cloud utility models for profit and ruin. In Proceedings of the IEEE International Conference on Cloud Computing (CLOUD’11). IEEE, 33--40. Google Scholar
Digital Library
- Daniel Kahneman and Amos Tversky. 1979. Prospect theory: An analysis of decision under risk. Econometrica 47, 2 (1979), 263--291. Google Scholar
Cross Ref
- Evangelia Kalyvianaki, Themistoklis Charalambous, and Steven Hand. 2009. Self-adaptive and self-configured CPU resource provisioning for virtualized servers using kalman filters. In Proceedings of the 6th International Conference on Autonomic Computing (ICAC’09). ACM, New York, NY, 117--126. DOI:http://dx.doi.org/10.1145/1555228.1555261 Google Scholar
Digital Library
- Dara Kusic, Jeffrey O. Kephart, James E. Hanson, Nagarajan Kandasamy, and Guofei Jiang. 2009. Power and performance management of virtualized computing environments via lookahead control. Cluster Comput. 12, 1 (2009), 1--15. Google Scholar
Digital Library
- J. J. Laffont. 2008. externalities. In The New Palgrave Dictionary of Economics, Steven N. Durlauf and Lawrence E. Blume (Eds.). Palgrave Macmillan, Basingstoke.Google Scholar
- Marin Litoiu. 2013. Optimization, Performance Evaluation and Resource Allocator (OPERA). Retrieved from http://www.ceraslabs.com/technologies/opera.Google Scholar
- Marin Litoiu, Mary Shaw, Gabriel Tamura, Norha M. Villegas, Hausi Müller, Holger Giese, Romain Rouvoy, and Eric Rutten. 2017. What Can Control Theory Teach Us About Assurances in Self-Adaptive Software Systems? R. de Lemos, D. Garlan, C. Ghezzi, H. Giese (eds.). Software Engineering for Self-Adaptive Systems 3: Assurances, 9640, Springer, 2017, LNCS, <http://www.dagstuhl.de/en/program/calendar/semhp/?semnr=13511>.<hal-01281063>Google Scholar
- Jan Marian Maciejowski. 2002. Predictive Control: With Constraints. Pearson Education.Google Scholar
- Ming Mao and Marty Humphrey. 2011. Auto-scaling to minimize cost and meet application deadlines in cloud workflows. In Proceedings of the 2011 International Conference for High Performance Computing, Networking, Storage and Analysis. ACM, 49. Google Scholar
Digital Library
- Ming Mao and Marty Humphrey. 2012. A performance study on the vm startup time in the cloud. In Proceedings of the IEEE 5th International Conference on Cloud Computing (CLOUD’12). IEEE, 423--430. Google Scholar
Digital Library
- Gabriel A. Moreno, Javier Cámara, David Garlan, and Bradley Schmerl. 2015. Proactive self-adaptation under uncertainty: A probabilistic model checking approach. In Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on Foundations of Software Engineering (ESEC/FSE’15).Google Scholar
Digital Library
- M. Naresh Kumar, P. Sujatha, Vamshi Kalva, Rohit Nagori, Anil Kumar Katukojwala, and Mukesh Kumar. 2012. Mitigating economic denial of sustainability (edos) in cloud computing using in-cloud scrubber service. In Proceedings of the 4th International Conference on Computational Intelligence and Communication Networks (CICN’12). IEEE, 535--539.Google Scholar
- Openstack. 2017. Heat: Openstack Orchestration. Retrieved from https://wiki.openstack.org/wiki/Heat.Google Scholar
- Khalid Rafique, Abdul Wahid Tareen, Muhammad Saeed, Jingzhu Wu, and Shahryar Shafique Qureshi. 2011. Cloud computing economics opportunities and challenges. In Proceedings of the 4th IEEE International Conference on Broadband Network and Multimedia Technology (IC-BNMT’11). IEEE, 401--406. Google Scholar
Cross Ref
- B. Russell. 2014. KVM and Docker LXC Benchmarking with OpenStack. Retrieved from http://bodenr.blogspot.ca/2014/05/kvm-and-docker-lxc-benchmarking-with.html.Google Scholar
- Nancy Samaan. 2014. A novel economic sharing model in a federation of selfish cloud providers. IEEE Trans. Parallel Distrib Syst. 25, 1 (2014), 12--21. Google Scholar
Digital Library
- Amir Molzam Sharifloo, Andreas Metzger, Clément Quinton, Luciano Baresi, and Klaus Pohl. 2016. Learning and evolution in dynamic software product lines. In Proceedings of the 11th International Symposium on Software Engineering for Adaptive and Self-Managing Systems. ACM, 158--164. Google Scholar
Digital Library
- Bhanu Sharma, Ruppa K. Thulasiram, Parimala Thulasiraman, Saurabh K. Garg, and Rajkumar Buyya. 2012. Pricing cloud compute commodities: A novel financial economic model. In Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid computing (CCGRID’12). IEEE Computer Society, 451--457. Google Scholar
Digital Library
- Mark Shtern, Michael Smit, Bradley Simmons, and Marin Litoiu. 2014. A runtime cloud efficiency software quality metric. In Companion Proceedings of the 36th International Conference on Software Engineering. ACM, 416--419. Google Scholar
Digital Library
- Joaquim Silvestre. 1987. Economies and diseconomies of scale. In The New Palgrave: A Dictionary of Economics, John Eatwell, Murray Milgate, and Peter Newman (Eds.). Palgrave Macmillan, Basingstoke. Google Scholar
Cross Ref
- Torsten Söderström and Petre Stoica. 1988. System Identification. Prentice-Hall.Google Scholar
- Diomidis Spinellis. 2016. Being a devops developer. IEEE Softw. 33, 3 (2016), 4--5. Google Scholar
Digital Library
- Basem Suleiman. 2012. Elasticity economics of cloud-based applications. In 2012 IEEE 9th International Conference on Services Computing (SCC’12). IEEE, 694--695. Google Scholar
Digital Library
- Byung Chul Tak, Bhuvan Urgaonkar, and Anand Sivasubramaniam. 2011. To move or not to move: The economics of cloud computing. In Proceedings of the 3rd USENIX Conference on Hot Topics in Cloud Computing. USENIX Association, 5--5.Google Scholar
- Zhen Ye, Athman Bouguettaya, and Xiaofang Zhou. 2014. Economic model-driven cloud service composition. ACM Trans. Internet Technol. 14, 2-3 (2014), 20.Google Scholar
Digital Library
- Tao Zheng, C. Murray Woodside, and Marin Litoiu. 2008. Performance model estimation and tracking using optimal filters. IEEE Trans. Softw. Eng. 34, 3 (2008), 391--406. Google Scholar
Digital Library
- Tao Zheng, Jinmei Yang, Murray Woodside, Marin Litoiu, and Gabriel Iszlai. 2005. Tracking time-varying parameters in software systems with extended kalman filters. In Proceedings of the 2005 Conference of the Centre for Advanced Studies on Collaborative Research. IBM Press, 334--345.Google Scholar
Digital Library
- Liming Zhu, Len Bass, and George Champlin-Scharff. 2016. DevOps and its practices. IEEE Softw. 33, 3 (2016), 32--34. Google Scholar
Cross Ref
- Parisa Zoghi, Mark Shtern, Marin Litoiu, and Hamoun Ghanbari. 2016. Designing adaptive applications deployed on cloud environments. ACM Trans. Auton. Adapt. Syst. 10, 4 (2016), 25. Google Scholar
Digital Library
Index Terms
From DevOps to BizOps: Economic Sustainability for Scalable Cloud Applications
Recommendations
DevOps patterns to scale web applications using cloud services
SPLASH '13: Proceedings of the 2013 companion publication for conference on Systems, programming, & applications: software for humanityScaling a web applications can be easy for simple CRUD software running when you use Platform as a Service Clouds (PaaS). But if you need to deploy a complex software, with many components and a lot users, you will need have a mix of cloud services in ...
CloudMF: Model-Driven Management of Multi-Cloud Applications
Special Issue on Internetware and Devops and Regular PapersWhile the number of cloud solutions is continuously increasing, the development and operation of large-scale and distributed cloud applications are still challenging. A major challenge is the lack of interoperability between the existing cloud solutions,...
A Survey and Taxonomy of Self-Aware and Self-Adaptive Cloud Autoscaling Systems
Autoscaling system can reconfigure cloud-based services and applications, through various configurations of cloud software and provisions of hardware resources, to adapt to the changing environment at runtime. Such a behavior offers the foundation for ...






Comments