skip to main content
research-article

ASTROLABE: A Rigorous Approach for System-Level Performance Modeling and Analysis

Published:11 March 2016Publication History
Skip Abstract Section

Abstract

Building abstract system-level models that faithfully capture performance and functional behavior for embedded systems design is challenging. Unlike functional aspects, performance details are rarely available during the early design phases, and no clear method is known to characterize them. Moreover, once such models are built, they are inherently complex as they mix software models, hardware constraints, and environment abstractions. Their analysis by using traditional performance evaluation methods is reaching the limit. In this article, we present a systematic approach for building stochastic abstract performance models using statistical inference and model calibration, and we propose statistical model checking as a scalable performance evaluation technique for them.

References

  1. S. Ahuja, D. A. Mathaikutty, A. Lakshminarayana, and S. K. Shukla. 2009. Scope: Statistical regression based power models for co-processors power estimation. Journal of Low Power Electronics 5, 4 (2009), 407--415.Google ScholarGoogle ScholarCross RefCross Ref
  2. T. W. Anderson. 1996. The New Statistical Analysis of Data. Springer.Google ScholarGoogle Scholar
  3. L. Aştefănoaei, S. B. Rayana, S. Bensalem, M. Bozga, and J. Combaz. 2014. Compositional invariant generation for timed systems. In Tools and Algorithms for the Construction and Analysis of Systems (TACAS'14). Springer, 263--278.Google ScholarGoogle Scholar
  4. C. Baier and J. P. Katoen. 2008. Principles of Model Checking. MIT Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. A. Bakshi, V. K. Prasanna, and A. Ledeczi. 2001. MILAN: A model based integrated simulation framework for design of embedded systems. In Proceedings of the 2001 ACM SIGPLAN Workshop on Optimization of Middleware and Distributed Systems (OM'01). ACM, 82--93. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. A. Basu, B. Bensalem, M. Bozga, J. Combaz, M. Jaber, T.-H. Nguyen, and J. Sifakis. 2011b. Rigorous component-based system design using the BIP framework. IEEE Software 28, 3 (May 2011), 41--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. A. Basu, S. Bensalem, M. Bozga, P. Bourgos, M. Maheshwari, and J. Sifakis. 2011a. Component assemblies in the context of manycore. In Formal Methods for Components and Objects, 10th International Symposium (FMCO'11). 314--333.Google ScholarGoogle Scholar
  8. G. Behrmann, A. David, and K. G. Larsen. 2004. A tutorial on Uppaal. In Formal Methods for the Design of Computer, Communication, and Software Systems (SFM-RT'04). 200--236.Google ScholarGoogle Scholar
  9. S. Bensalem, M. Bozga, B. Delahaye, C. Jégourel, A. Legay, and A. Nouri. 2012. Statistical model checking QoS properties of systems with SBIP. In International Symposium on Leveraging Applications of Formal Methods, Verification and Validation (ISOLA'12). 327--341. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. B. Bonakdarpour, M. Bozga, M. Jaber, J. Quilbeuf, and J. Sifakis. 2012. A framework for automated distributed implementation of component-based models. Distributed Computing 25, 5 (2012), 383--409.Google ScholarGoogle ScholarCross RefCross Ref
  11. P. Bourgos. 2013. Rigorous Design Flow for Programming Manycore Platforms. Ph. D. Dissertation. Université de Grenoble. https://tel.archives-ouvertes.fr/tel-01135186.Google ScholarGoogle Scholar
  12. G. E. P. Box and D. A. Pierce. 1970. Distribution of residual autocorrelations in autoregressive-integrated moving average time series models. Journal of the American Statistical Association 65 (1970), 1509--1526.Google ScholarGoogle ScholarCross RefCross Ref
  13. P. E. Bulychev, A. David, K. G. Larsen, M. Mikucionis, D. B. Poulsen, A. Legay, and Z. Wang. 2012. UPPAAL-SMC: Statistical model checking for priced timed automata. In Proceedings of the 10th Workshop on Quantitative Aspects of Programming Languages and Systems (QAPL'12). 1--16.Google ScholarGoogle Scholar
  14. G. Cowan. 1998. Statistical Data Analysis. Oxford University Press, Oxford.Google ScholarGoogle Scholar
  15. A. E. Dalsgaard, M. C. Olesen, M. Toft, R. R. Hansen, and K. G. Larsen. 2010. METAMOC: Modular execution time analysis using model checking. In International Workshop on Worst-Case Execution Time Analysis (WCET'10). 113--123.Google ScholarGoogle Scholar
  16. M. L. Delignette-Muller, R. Pouillot, J.-B. Denis, and C. Dutang. 2010. Fitdistrplus: Help to Fit of a Parametric Distribution to Non-Censored or Censored Data. Retrieved from http://cran.r-project.org/package=fitdistrplus.Google ScholarGoogle Scholar
  17. P. Giusto, G. Martin, and E. Harcourt. 2001. Reliable estimation of execution time of embedded software. In Proceedings of Design, Automation and Test in Europe (DATE'01). IEEE Press, 580--589. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. W. Haid, M. Keller, K. Huang, I. Bacivarov, and L. Thiele. 2009. Generation and calibration of compositional performance analysis models for multi-processor systems. In International Conference on Systems, Architectures, Modeling and Simulation (SAMOS'09). 92--99. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. R. Henia, A. Hamann, M. Jersak, R. Racu, K. Richter, and R. Ernst. 2005. System level performance analysis - the SymTA/S approach. In IEEE Proceedings Computers and Digital Techniques.Google ScholarGoogle Scholar
  20. T. Hérault, R. Lassaigne, F. Magniette, and S. Peyronnet. 2004. Approximate probabilistic model checking. In International Conference on Verification, Model Checking, and Abstract Interpretation (VMCAI'04). 73--84.Google ScholarGoogle Scholar
  21. G. Kahn. 1974. The semantics of simple language for parallel programming. In IFIP Congress. 471--475.Google ScholarGoogle Scholar
  22. K. Keutzer, S. Malik, A. R. Newton, J. M. Rabaey, and A. Sangiovanni-Vincentelli. 2000. System-level design: Orthogonalization of concerns and platform-based design. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 19 (2000), 1523--1543. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. B. Kienhuis, E. F. Deprettere, P. van der Wolf, and K. A. Vissers. 2002. A methodology to design programmable embedded systems - the Y-chart approach. In Embedded Processor Design Challenges: Systems, Architectures, Modeling, and Simulation (SAMOS'02). Springer-Verlag, London, 18--37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. M. Kwiatkowska, G. Norman, and D. Parker. 2009. PRISM: Probabilistic model checking for performance and reliability analysis. ACM SIGMETRICS Performance Evaluation Review 36, 4 (2009), 40--45. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. J.-Y. Le Boudec. 2010. Performance Evaluation of Computer and Communication Systems. EPFL Press, Lausanne, Switzerland. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. G. M. Ljung and G. E. P. Box. 1978. On a measure of lack of fit in time series models. Biometrika 65, 2 (Aug. 1978), 297--303.Google ScholarGoogle ScholarCross RefCross Ref
  27. H. Mao, Y. Chen, M. Jaeger, T. D. Nielsen, K. G. Larsen, and B. Nielsen. 2011. Learning probabilistic automata for model checking. In International Conference on Quantitative Evaluation of SysTems (QEST'11). 111--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. H. Mao, Y. Chen, M. Jaeger, T. D. Nielsen, K. G. Larsen, and B. Nielsen. 2012. Learning Markov decision processes for model checking. Quantities in Formal Methods (QFM'12). 49--63.Google ScholarGoogle Scholar
  29. D. Melpignano, L. Benini, E. Flamand, B. Jego, T. Lepley, G. Haugou, F. Clermidy, and D. Dutoit. 2012. Platform 2012, a many-core computing accelerator for embedded SoCs: Performance evaluation of visual analytics applications. In Proceedings of the 49th Annual Design Automation Conference (DAC'12). ACM, 1137--1142. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. S. Mohanty and V. K. Prasanna. 2002. Rapid system-level performance evaluation and optimization for application mapping onto SoC architectures. In Proceedings of the IEEE International ASIC/SOC Conference.Google ScholarGoogle Scholar
  31. J. Mutch and D. G. Lowe. 2008. Object class recognition and localization using sparse features with limited receptive fields. International Journal of Computer Vision 80, 1, 45--57. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. A. Nouri. 2015. Rigorous System-Level Modeling and Performance Evaluation for Embedded System Design. Ph. D. Dissertation. Université Grenoble Alpes.Google ScholarGoogle Scholar
  33. A. Nouri, S. Bensalem, M. Bozga, B. Delahaye, C. Jégourel, and A. Legay. 2015. Statistical model checking QoS properties of systems with SBIP. International Journal on Software Tools for Technology Transfer 17, 2 (2015), 171--185. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. A. Nouri, M. Bozga, A. Molnos, A. Legay, and S. Bensalem. 2014a. Building faithful high-level models and performance evaluation of manycore embedded systems. In Proceedings of the 12th ACM/IEEE International Conference on Formal Methods and Models for Codesign (MEMOCODE'14). IEEE, 209--218.Google ScholarGoogle Scholar
  35. A. Nouri, B. Raman, M. Bozga, A. Legay, and S. Bensalem. 2014b. Faster statistical model checking by means of abstraction and learning. In Runtime Verification - 5th International Conference (RV'14). Springer, 340--355.Google ScholarGoogle Scholar
  36. A. D. Pimentel. 2008. The Artemis workbench for system-level performance evaluation of embedded systems. International Journal of Embedded Systems 3, 3, 181--196.Google ScholarGoogle ScholarCross RefCross Ref
  37. A. D. Pimentel, C. Erbas, and S. Polstra. 2006. A systematic approach to exploring embedded system architectures at multiple abstraction levels. IEEE Transactions on Computers 55, 2 (2006), 99--112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. A. D. Pimentel, M. Thompson, S. Polstra, and C. Erbas. 2008. Calibration of abstract performance models for system-level design space exploration. Journal of Signal Processing Systems 50, 2 (Feb. 2008), 99--114. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. A. Pnueli. 1977. The temporal logic of programs. In Proceedings of the 18th Annual Symposium on Foundations of Computer Science (SFCS'77). IEEE Computer Society, Washington, DC, 46--57. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. L. Thiele, I. Bacivarov, W. Haid, and K. Huang. 2007. Mapping applications to tiled multiprocessor embedded systems. In International Conference on Application of Concurrency to System Design (ACSD'07). 29--40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. L. Thiele, S. Chakraborty, and M. Naedele. 2000. Real-time calculus for scheduling hard real-time systems. In International Symposium on Circuits and Systems (ISCAS'00), Vol. 4. 101--104.Google ScholarGoogle Scholar
  42. D. Vose. 2008. Risk Analysis: A Quantitative Guide. Wiley.Google ScholarGoogle Scholar
  43. H. L. S. Younes. 2005. Verification and Planning for Stochastic Processes with Asynchronous Events. Ph. D. Dissertation. Carnegie Mellon. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. ASTROLABE: A Rigorous Approach for System-Level Performance Modeling and Analysis

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader
            About Cookies On This Site

            We use cookies to ensure that we give you the best experience on our website.

            Learn more

            Got it!