skip to main content
research-article

A Novel Resource Optimization Algorithm Based on Clustering and Improved Differential Evolution Strategy Under a Cloud Environment

Authors Info & Claims
Published:30 June 2021Publication History
Skip Abstract Section

Abstract

Resource optimization algorithm based on clustering and improved differential evolution strategy, as a new global optimized algorithm, has wide applications in language translation, language processing, document understanding, cloud computing, and edge computing due to high efficiency. With the development of deep learning technology and the rise of big data, the resource optimization algorithm encounters a series of challenges, such as the workload imbalance and low resource utilization. To address the preceding problems, this study proposes a novel resource optimization algorithm based on clustering and an improved differential evolution strategy (Multi-objective Task Scheduling Strategy (MTSS)). Three indexes, namely task completion time, execution cost, and workload, of virtual machines are selected and used to build the fitness function of the MTSS algorithm. At the same time, the preprocessing state is set up to cluster according to the resource and task characteristics to reduce the magnitude of their matching scale. Moreover, to solve the workload imbalance among different resource sets, local resource tasks are reallocated using the Q-value method in the MTSS strategy to achieve workload balance of global resources and improve the resource utilization rate. Experiments are carried out to evaluate the effectiveness of the proposed algorithm. Results show that the proposed algorithm outperforms other algorithms in terms of task completion time, execution cost, and workload balancing.

References

  1. Mutaz Barika, Saurabh Garg, Albert Y. Zomaya, Lizhe Wang, Aad Van Moorsel, and Rajiv Ranjan. 2019. Orchestrating big data analysis workflows in the cloud: Research challenges, survey, and future directions. ACM Computing Surveys 52, 5 (2019), 1–41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Kim Hyun, Lee Jong-Hyeok, and Na Seung-Hoon. 2019. Multi-task stack propagation for neural quality estimation. ACM Transactions on Asian and Low-Resource Language Information Processing 18, 4 (2019), 1–18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Hong Cheol-Ho and Varghese Blesson. 2018. Resource management in fog/edge computing: A survey. ACM Computing Surveys 52, 5 (2018), 1–37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Rajiv Ranjan, Saurabh Garg, Ali Reza Khoskbar, Ellis Solaiman, Philip James, and Dimitrios Georgakopoulos. 2017. Orchestrating bigdata analysis workflows. IEEE Cloud Computing 4, 3 (2017), 20–28.Google ScholarGoogle ScholarCross RefCross Ref
  5. Gilbert Badaro, Ramy Baly, Hazem Haji, Wassim El-Hajj, Khaled Bashir Shaban, Nizar Habash, Ahmad Al-Sallab, and Ali Hamdi. 2019. A survey of opinion mining in Arabic: A comprehensive system perspective covering challenges and advances in tools, resources, models, applications, and visualizations. ACM Transactions on Asian and Low-Resource Language Information Processing 18, 3 (2019), 1–52. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Veysel Yucesoy and Aykut Koc. 2019. Co-occurrence weight selection in generation of word embeddings for low resource languages. ACM Transactions on Asian and Low-Resource Language Information Processing 18, 3 (2019), 1–18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Amrita Jyoti and Manish Shrimali. 2020. Dynamic provisioning of resources based on load balancing and service broker policy in cloud computing. Cluster Computing 23, 1 (2020), 377–395.Google ScholarGoogle ScholarCross RefCross Ref
  8. M. Lavanya, B. Shanthi, and S. Saravanan. 2020. Multi objective task scheduling algorithm based on SLA and processing time suitable for cloud environment. Cluster Computing 151, 1 (2020), 183–195.Google ScholarGoogle Scholar
  9. K. Etminani and M. Naghibzadeh. 2007. A Min-Min Max-Min selective algorithm for grid task scheduling. In Proceedings of the 3rd IEEE/IFIP International Conference in Central Asia on Internet. 1–7.Google ScholarGoogle Scholar
  10. M. Aruna, D. Bhanu, and S. Karthik. 2019. An improved load balanced metaheuristic scheduling in cloud. Cluster Computing 22, 5 (2019), 10873–10881.Google ScholarGoogle ScholarCross RefCross Ref
  11. A. M. Senthil Kumar, K. Parthiban, and S. Siva Shankar. 2019. An efficient task scheduling in a cloud computing environment using hybrid genetic algorithm—Particle swarm optimization (GA-PSO) algorithm. In Proceedings of the 2019 International Conference on Intelligent Sustainable Systems (ICISS’19). 29–34.Google ScholarGoogle Scholar
  12. Sanjaya K. Panda, Indrajeet Gupta, and Prasanta K. Jana. 2019. Task scheduling algorithms for multi-cloud systems: Allocation-aware approach. Information Systems Frontiers 21, 2 (2019), 241–259. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Zhou Zhou and Hu Zhigang. 2014. Task scheduling algorithm based on greedy strategy in cloud computing. Open Cybernetics and Systemics Journal 8, 1 (2014), 111–114.Google ScholarGoogle Scholar
  14. Zhou Zhou, Houliang Xie, and Fangmin Li. 2019. A novel task scheduling algorithm integrated with priority and greedy strategy in cloud computing. Journal of Intelligent and Fuzzy Systems 37, 4 (2019), 4647–4655Google ScholarGoogle ScholarCross RefCross Ref
  15. Yun-Han Lee, Seiven Leu, and Ruay-Shiung Chang. 2011. Improving job scheduling algorithms in a grid environment. Future Generation Computer Systems 27, 8 (2011), 991–998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Zhou Zhou, Hongmin Wang, Huailing Shao, Lifeng Dong, and Junyang Yu. 2020. A high-performance scheduling algorithm using greedy strategy toward quality of service in the cloud environments. Peer-to-Peer Networking and Applications 13 (2020), 2214–2223. DOI:https://doi.org/10.1007/s12083-020-00888-4Google ScholarGoogle ScholarCross RefCross Ref
  17. F. Otero, A. A. Freitas, and C. G. Johnson. 2012. Inducing decision trees with an ant colony optimization algorithm. Applied Soft Computing 12, 11 (2012), 3615–3626. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Yangyang Dai, Yuansheng Lou, and Xin Lu. 2015. A task scheduling algorithm based on genetic algorithm and ant colony optimization algorithm with multi-QoS constraints in cloud computing. In Proceedings of the IEEE International Conference on Intelligent Human-Machine Systems and Cybernetics. 428–431.Google ScholarGoogle ScholarCross RefCross Ref
  19. Clara Pizzuti. 2012. A multiobjective genetic algorithm to find communities in complex networks. IEEE Transactions on Evolutionary Computation 16, 3 (2012), 418–430. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Zhou Zhou, Fangmin Li, Huaxi Zhu, Houliang Xie, Jemal Abawajy, and Morshed Chowdhury. 2020. An improved genetic algorithm using greedy strategy toward task scheduling optimization in cloud environments. Neural Computing and Applications 32, 6 (2020), 1531–1541.Google ScholarGoogle ScholarCross RefCross Ref
  21. Zhou Zhou, Fangmin Li, Jemal Abawajy, and Chaochao Gao. 2020. Improved PSO algorithm integrated with opposition-based learning and tentative perception in networked data centres. IEEE Access 8, 1 (2020), 55872–55880.Google ScholarGoogle ScholarCross RefCross Ref
  22. Zhou Zhou, Jian Chang, Zhigang Hu, Junyang Yu, and Fangmin Li. 2018. A modified PSO algorithm for task scheduling optimization in cloud computing. Concurrency and Computation: Practice and Experience 30, 24 (2018), 1–11.Google ScholarGoogle ScholarCross RefCross Ref
  23. Qingfeng Ding and Xiaoyu Yin. 2017. Research survey of differential evolution algorithms. CAAI Transactions on Intelligent Systems 12, 1 (2017), 431–442.Google ScholarGoogle Scholar
  24. Yong Wang, Cai Zixing, and Qingfu Zhang. 2011. Differential evolution with composite trial vector generation strategies and control parameters. IEEE Transactions on Evolutionary Computation 15, 1 (2011), 55–66. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Yuqing Li, Shichuan Wang, Xin Hong, and Yongzhi Li. 2018. Multi-objective task scheduling optimization in cloud computing based on genetic algorithm and differential evolution algorithm. In Proceedings of the 2018 37th Chinese Control Conference (CCC’18). IEEE, Los Alamitos, CA, 4489–4494Google ScholarGoogle ScholarCross RefCross Ref
  26. Wenjuan Li, Q.-F. Zhang, L.-D. Ping, and X.-Z. Pan. 2012. Cloud scheduling algorithm based on fuzzy clustering. Journal on Communications 33, 3 (2012), 146–154.Google ScholarGoogle Scholar
  27. Toshihiro Kujirai and Takayoshi Yokota. 2018. Greedy action selection and pessimistic Q-value updates in cooperative Q-learning. In Proceedings of the 2018 57th Annual Conference of the Society of Instrument and Control Engineers of Japan. IEEE, Los Alamitos, CA, 821–826.Google ScholarGoogle Scholar
  28. Zhou Zhou, Mohammad Shojafar, Mamoun Alazab, Jemal Abawajy, and Fangmin Li. 2021. AFED-EF: An energy-efficient VM allocation algorithm for IoT applications in a cloud data center. IEEE Transactions on Green Communications and Networking 5, 2 (2021), 658–669. DOI:https://doi.org/10.1109/TGCN.2021.3067309Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A Novel Resource Optimization Algorithm Based on Clustering and Improved Differential Evolution Strategy Under a Cloud Environment

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader

            HTML Format

            View this article in HTML Format .

            View HTML Format
            About Cookies On This Site

            We use cookies to ensure that we give you the best experience on our website.

            Learn more

            Got it!