skip to main content
research-article

Self-Adaptive QoS Management of Computation and Communication Resources in Many-Core SoCs

Published:10 June 2019Publication History
Skip Abstract Section

Abstract

Providing quality of service (QoS) for many-core systems with dynamic application admission is challenging due to the high amount of resources to manage and the unpredictability of computation and communication events. Related works propose a self-adaptive QoS mechanism concerned either in communication or computation resources, lacking, however, a comprehensive QoS management of both. Assuming a many-core system with QoS monitoring, runtime circuit-switching establishment, task migration, and a soft real-time task scheduler, this work fills this gap by proposing a novel self-adaptive QoS management. The contribution of this proposal comes with the following features in the QoS management: (i) comprehensiveness, by covering communication and computation resources; (ii) online, adopting the ODA (Observe, Decide, Act) runtime closed-loop adaptation; and (iii) reactive and proactive decisions, by using a dynamic application profile extraction technique, which enables the QoS management to be aware of the profile of running applications, allowing it to take proactive decisions based on a prediction analysis. The proposed QoS management adopts a decentralized organization by partitioning the system in clusters, each one managed by a dedicated processor, making the proposal scalable. Results show that the proactive feature accurately extracts the applications’ profile, and can prevent future QoS violations. The synergy of reactive and proactive decisions was able to sustain QoS, reducing the deadline miss rate by 99.5% with a severe disturbance in communication and computation levels, and avoiding deadline misses up to 70% of system utilization.

References

  1. Gean Abich, Marcelo Mandelli, Felipe R. Rosa, Fernando G. Moraes, Luciano Ost, and Ricardo Reis. 2016. Extending freeRTOS to support dynamic and distributed mapping in multiprocessor systems. In ICECS. IEEE, 712--715.Google ScholarGoogle Scholar
  2. Ahmed Abousamra, Alex K. Jones, and Rami G. Melhem. 2013. Proactive circuit allocation in multiplane NoCs. In DAC. ACM, 35:1--35:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Brent Bohnenstiehl, Aaron Stillmaker, Jon Pimentel, Timothy Andreas, Bin Liu, Anh Tran, Emmanuel Adeagbo, and Bevan Baas. 2017. KiloCore: A 32-nm 1000-processor computational array. J. Solid-State Circuits 52, 4 (2017), 891--902.Google ScholarGoogle ScholarCross RefCross Ref
  4. Guilherme Castilhos, Marcelo Mandelli, Guilherme Madalozzo, and Fernando G. Moraes. 2013. Distributed resource management in NoC-based MPSoCs with dynamic cluster sizes. In ISVLSI. IEEE, 153--158.Google ScholarGoogle Scholar
  5. Christina Delimitrou and Christos Kozyrakis. 2013. QoS-aware scheduling in heterogeneous datacenters with paragon. ACM Trans. Comput. Syst. 31, 4 (Dec. 2013), 12:1--12:34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Nikil D. Dutt, Fadi J. Kurdahi, Rolf Ernst, and Andreas Herkersdorf. 2016. Conquering MPSoC complexity with principles of a self-aware information processing factory. In CODES+ISSS. ACM, 37:1--37:4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Kunal P. Ganeshpure and Sandip Kundu. 2013. On runtime task graph extraction in MPSoC. In ISVLSI. IEEE, 171--176.Google ScholarGoogle Scholar
  8. Henry Hoffmann, Martina Maggio, Marco D. Santambrogio, Alberto Leva, and Anant Agarwal. 2013. A generalized software framework for accurate and efficient management of performance goals. In EMSOFT. IEEE, 19:1--19:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Axel Jantsch, Nikil D. Dutt, and Amir M. Rahmani. 2017. Self-awareness in systems on chip---A survey. IEEE Design 8 Test 34, 6 (2017), 8--26.Google ScholarGoogle Scholar
  10. Jaume Joven, Andrea Marongiu, Federico Angiolini, Luca Benini, and Giovanni De Micheli. 2013. An integrated, programming model-driven framework for NoC-QoS support in cluster-based embedded many-cores. Parallel Comput. 39, 10 (2013), 549--566. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Hanwoong Jung, Chanhee Lee, Shin-Haeng Kang, Sungchan Kim, Hyunok Oh, and Soonhoi Ha. 2014. Dynamic behavior specification and dynamic mapping for real-time embedded systems: HOPE approach. ACM Trans. Embedded Comput. Syst. 13, 4s (2014), 135:1--135:26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Peter R. Lewis, Marco Platzner, Bernhard Rinner, Jim Trresen, and Xin Yao. 2016. Self-aware Computing Systems: An Engineering Approach (1st ed.). Springer. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. N. Loubet et al. 2017. Stacked nanosheet gate-all-around transistor to enable scaling beyond FinFET. In Symposium on VLSI Technology. IEEE, 230--231.Google ScholarGoogle ScholarCross RefCross Ref
  14. Daniele Mangano and Giovanni Strano. 2010. Enabling dynamic and programmable QoS in SoCs. In NoCArc. ACM, 17--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Aline Mello, Leonel Tedesco, Ney Calazans, and Fernando Moraes. 2006. Evaluation of current QoS mechanisms in networks on chip. In SOC. IEEE, 1--4.Google ScholarGoogle Scholar
  16. Luciano Ost et al. 2013. Power-aware dynamic mapping heuristics for NoC-based MPSoCs using a unified model-based approach. ACM Trans. Embedded Comput. Syst. 12, 3 (2013), 75:1--75:22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Sangsoo Park. 2014. Task-I/O Co-scheduling for pfair real-time scheduler in embedded multi-core systems. In EUC. IEEE, 46--51. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Vinicius Petrucci, Michael A. Laurenzano, John Doherty, Yunqi Zhang, Daniel Mossé, Jason Mars, and Lingjia Tang. 2015. Octopus-Man: QoS-driven task management for heterogeneous multicores in warehouse-scale computers. In HPCA. IEEE, 246--258.Google ScholarGoogle Scholar
  19. GAPH PUCRS. 2018. Hermes Multiprocessor System-on-Chip. Retrieved from http://www.inf.pucrs.br/hemps/index.html.Google ScholarGoogle Scholar
  20. Wei Quan and Andy D. Pimentel. 2016. A hierarchical run-time adaptive resource allocation framework for large-scale MPSoC systems. Design Autom. Emb. Sys. 20, 4 (2016), 311--339. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Marcelo Ruaro, Everton Carara, and Fernando G. Moraes. 2015. Runtime adaptive circuit switching and flow priority in NoC-based MPSoCs. IEEE Trans. VLSI Syst. 23, 6 (2015), 1077--1088.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Marcelo Ruaro, Henrique Medina, Alexandre Amory, and Fernando G. Moraes. 2018. Software-defined networking architecture for NoC-based many-cores. In ISCAS. IEEE, 385--390.Google ScholarGoogle Scholar
  23. Marcelo Ruaro and Fernando G. Moraes. 2016. Dynamic real-time scheduler for large-scale MPSoCs. In GLSVLSI. ACM, 341--346.Google ScholarGoogle Scholar
  24. Marcelo Ruaro and Fernando G. Moraes. 2017. Demystifying the cost of task migration in distributed memory many-core systems. In ISCAS. IEEE, 1--4.Google ScholarGoogle Scholar
  25. Amit Kumar Singh, Piotr Dziurzanski, Hashan Roshantha Mendis, and Leandro Soares Indrusiak. 2017. A survey and comparative study of hard and soft real-time dynamic resource allocation strategies for multi-/many-core systems. ACM Comput. Surv. 50, 2 (April 2017), 24:1--24:40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Markus Winter and Gerhard P. Fettweis. 2011. Guaranteed service virtual channel allocation in NoCs for run-time task scheduling. In DATE. IEEE, 419--424.Google ScholarGoogle Scholar

Index Terms

  1. Self-Adaptive QoS Management of Computation and Communication Resources in Many-Core SoCs

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!