Abstract
Building abstract system-level models that faithfully capture performance and functional behavior for embedded systems design is challenging. Unlike functional aspects, performance details are rarely available during the early design phases, and no clear method is known to characterize them. Moreover, once such models are built, they are inherently complex as they mix software models, hardware constraints, and environment abstractions. Their analysis by using traditional performance evaluation methods is reaching the limit. In this article, we present a systematic approach for building stochastic abstract performance models using statistical inference and model calibration, and we propose statistical model checking as a scalable performance evaluation technique for them.
- S. Ahuja, D. A. Mathaikutty, A. Lakshminarayana, and S. K. Shukla. 2009. Scope: Statistical regression based power models for co-processors power estimation. Journal of Low Power Electronics 5, 4 (2009), 407--415.Google Scholar
Cross Ref
- T. W. Anderson. 1996. The New Statistical Analysis of Data. Springer.Google Scholar
- L. Aştefănoaei, S. B. Rayana, S. Bensalem, M. Bozga, and J. Combaz. 2014. Compositional invariant generation for timed systems. In Tools and Algorithms for the Construction and Analysis of Systems (TACAS'14). Springer, 263--278.Google Scholar
- C. Baier and J. P. Katoen. 2008. Principles of Model Checking. MIT Press. Google Scholar
Digital Library
- A. Bakshi, V. K. Prasanna, and A. Ledeczi. 2001. MILAN: A model based integrated simulation framework for design of embedded systems. In Proceedings of the 2001 ACM SIGPLAN Workshop on Optimization of Middleware and Distributed Systems (OM'01). ACM, 82--93. Google Scholar
Digital Library
- A. Basu, B. Bensalem, M. Bozga, J. Combaz, M. Jaber, T.-H. Nguyen, and J. Sifakis. 2011b. Rigorous component-based system design using the BIP framework. IEEE Software 28, 3 (May 2011), 41--48. Google Scholar
Digital Library
- A. Basu, S. Bensalem, M. Bozga, P. Bourgos, M. Maheshwari, and J. Sifakis. 2011a. Component assemblies in the context of manycore. In Formal Methods for Components and Objects, 10th International Symposium (FMCO'11). 314--333.Google Scholar
- G. Behrmann, A. David, and K. G. Larsen. 2004. A tutorial on Uppaal. In Formal Methods for the Design of Computer, Communication, and Software Systems (SFM-RT'04). 200--236.Google Scholar
- S. Bensalem, M. Bozga, B. Delahaye, C. Jégourel, A. Legay, and A. Nouri. 2012. Statistical model checking QoS properties of systems with SBIP. In International Symposium on Leveraging Applications of Formal Methods, Verification and Validation (ISOLA'12). 327--341. Google Scholar
Digital Library
- B. Bonakdarpour, M. Bozga, M. Jaber, J. Quilbeuf, and J. Sifakis. 2012. A framework for automated distributed implementation of component-based models. Distributed Computing 25, 5 (2012), 383--409.Google Scholar
Cross Ref
- P. Bourgos. 2013. Rigorous Design Flow for Programming Manycore Platforms. Ph. D. Dissertation. Université de Grenoble. https://tel.archives-ouvertes.fr/tel-01135186.Google Scholar
- G. E. P. Box and D. A. Pierce. 1970. Distribution of residual autocorrelations in autoregressive-integrated moving average time series models. Journal of the American Statistical Association 65 (1970), 1509--1526.Google Scholar
Cross Ref
- P. E. Bulychev, A. David, K. G. Larsen, M. Mikucionis, D. B. Poulsen, A. Legay, and Z. Wang. 2012. UPPAAL-SMC: Statistical model checking for priced timed automata. In Proceedings of the 10th Workshop on Quantitative Aspects of Programming Languages and Systems (QAPL'12). 1--16.Google Scholar
- G. Cowan. 1998. Statistical Data Analysis. Oxford University Press, Oxford.Google Scholar
- A. E. Dalsgaard, M. C. Olesen, M. Toft, R. R. Hansen, and K. G. Larsen. 2010. METAMOC: Modular execution time analysis using model checking. In International Workshop on Worst-Case Execution Time Analysis (WCET'10). 113--123.Google Scholar
- M. L. Delignette-Muller, R. Pouillot, J.-B. Denis, and C. Dutang. 2010. Fitdistrplus: Help to Fit of a Parametric Distribution to Non-Censored or Censored Data. Retrieved from http://cran.r-project.org/package=fitdistrplus.Google Scholar
- P. Giusto, G. Martin, and E. Harcourt. 2001. Reliable estimation of execution time of embedded software. In Proceedings of Design, Automation and Test in Europe (DATE'01). IEEE Press, 580--589. Google Scholar
Digital Library
- W. Haid, M. Keller, K. Huang, I. Bacivarov, and L. Thiele. 2009. Generation and calibration of compositional performance analysis models for multi-processor systems. In International Conference on Systems, Architectures, Modeling and Simulation (SAMOS'09). 92--99. Google Scholar
Digital Library
- R. Henia, A. Hamann, M. Jersak, R. Racu, K. Richter, and R. Ernst. 2005. System level performance analysis - the SymTA/S approach. In IEEE Proceedings Computers and Digital Techniques.Google Scholar
- T. Hérault, R. Lassaigne, F. Magniette, and S. Peyronnet. 2004. Approximate probabilistic model checking. In International Conference on Verification, Model Checking, and Abstract Interpretation (VMCAI'04). 73--84.Google Scholar
- G. Kahn. 1974. The semantics of simple language for parallel programming. In IFIP Congress. 471--475.Google Scholar
- K. Keutzer, S. Malik, A. R. Newton, J. M. Rabaey, and A. Sangiovanni-Vincentelli. 2000. System-level design: Orthogonalization of concerns and platform-based design. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 19 (2000), 1523--1543. Google Scholar
Digital Library
- B. Kienhuis, E. F. Deprettere, P. van der Wolf, and K. A. Vissers. 2002. A methodology to design programmable embedded systems - the Y-chart approach. In Embedded Processor Design Challenges: Systems, Architectures, Modeling, and Simulation (SAMOS'02). Springer-Verlag, London, 18--37. Google Scholar
Digital Library
- M. Kwiatkowska, G. Norman, and D. Parker. 2009. PRISM: Probabilistic model checking for performance and reliability analysis. ACM SIGMETRICS Performance Evaluation Review 36, 4 (2009), 40--45. Google Scholar
Digital Library
- J.-Y. Le Boudec. 2010. Performance Evaluation of Computer and Communication Systems. EPFL Press, Lausanne, Switzerland. Google Scholar
Digital Library
- G. M. Ljung and G. E. P. Box. 1978. On a measure of lack of fit in time series models. Biometrika 65, 2 (Aug. 1978), 297--303.Google Scholar
Cross Ref
- H. Mao, Y. Chen, M. Jaeger, T. D. Nielsen, K. G. Larsen, and B. Nielsen. 2011. Learning probabilistic automata for model checking. In International Conference on Quantitative Evaluation of SysTems (QEST'11). 111--120. Google Scholar
Digital Library
- H. Mao, Y. Chen, M. Jaeger, T. D. Nielsen, K. G. Larsen, and B. Nielsen. 2012. Learning Markov decision processes for model checking. Quantities in Formal Methods (QFM'12). 49--63.Google Scholar
- D. Melpignano, L. Benini, E. Flamand, B. Jego, T. Lepley, G. Haugou, F. Clermidy, and D. Dutoit. 2012. Platform 2012, a many-core computing accelerator for embedded SoCs: Performance evaluation of visual analytics applications. In Proceedings of the 49th Annual Design Automation Conference (DAC'12). ACM, 1137--1142. Google Scholar
Digital Library
- S. Mohanty and V. K. Prasanna. 2002. Rapid system-level performance evaluation and optimization for application mapping onto SoC architectures. In Proceedings of the IEEE International ASIC/SOC Conference.Google Scholar
- J. Mutch and D. G. Lowe. 2008. Object class recognition and localization using sparse features with limited receptive fields. International Journal of Computer Vision 80, 1, 45--57. Google Scholar
Digital Library
- A. Nouri. 2015. Rigorous System-Level Modeling and Performance Evaluation for Embedded System Design. Ph. D. Dissertation. Université Grenoble Alpes.Google Scholar
- A. Nouri, S. Bensalem, M. Bozga, B. Delahaye, C. Jégourel, and A. Legay. 2015. Statistical model checking QoS properties of systems with SBIP. International Journal on Software Tools for Technology Transfer 17, 2 (2015), 171--185. Google Scholar
Digital Library
- A. Nouri, M. Bozga, A. Molnos, A. Legay, and S. Bensalem. 2014a. Building faithful high-level models and performance evaluation of manycore embedded systems. In Proceedings of the 12th ACM/IEEE International Conference on Formal Methods and Models for Codesign (MEMOCODE'14). IEEE, 209--218.Google Scholar
- A. Nouri, B. Raman, M. Bozga, A. Legay, and S. Bensalem. 2014b. Faster statistical model checking by means of abstraction and learning. In Runtime Verification - 5th International Conference (RV'14). Springer, 340--355.Google Scholar
- A. D. Pimentel. 2008. The Artemis workbench for system-level performance evaluation of embedded systems. International Journal of Embedded Systems 3, 3, 181--196.Google Scholar
Cross Ref
- A. D. Pimentel, C. Erbas, and S. Polstra. 2006. A systematic approach to exploring embedded system architectures at multiple abstraction levels. IEEE Transactions on Computers 55, 2 (2006), 99--112. Google Scholar
Digital Library
- A. D. Pimentel, M. Thompson, S. Polstra, and C. Erbas. 2008. Calibration of abstract performance models for system-level design space exploration. Journal of Signal Processing Systems 50, 2 (Feb. 2008), 99--114. Google Scholar
Digital Library
- A. Pnueli. 1977. The temporal logic of programs. In Proceedings of the 18th Annual Symposium on Foundations of Computer Science (SFCS'77). IEEE Computer Society, Washington, DC, 46--57. Google Scholar
Digital Library
- L. Thiele, I. Bacivarov, W. Haid, and K. Huang. 2007. Mapping applications to tiled multiprocessor embedded systems. In International Conference on Application of Concurrency to System Design (ACSD'07). 29--40. Google Scholar
Digital Library
- L. Thiele, S. Chakraborty, and M. Naedele. 2000. Real-time calculus for scheduling hard real-time systems. In International Symposium on Circuits and Systems (ISCAS'00), Vol. 4. 101--104.Google Scholar
- D. Vose. 2008. Risk Analysis: A Quantitative Guide. Wiley.Google Scholar
- H. L. S. Younes. 2005. Verification and Planning for Stochastic Processes with Asynchronous Events. Ph. D. Dissertation. Carnegie Mellon. Google Scholar
Digital Library
Index Terms
ASTROLABE: A Rigorous Approach for System-Level Performance Modeling and Analysis
Recommendations
A Matrix-Based Method for Evaluating ISP Network Performance
ETCS '09: Proceedings of the 2009 First International Workshop on Education Technology and Computer Science - Volume 03ISP network performance evaluation is very important to the improvement of application performance, the optimum competition of ISP network and the operation and management of Internet. ISP network consists of one or several autonomous systems (AS), so ...
Automatic CUDA code synthesis framework for multicore CPU and GPU architectures
PPAM'11: Proceedings of the 9th international conference on Parallel Processing and Applied Mathematics - Volume Part IRecently, general purpose GPU (GPGPU) programming has spread rapidly after CUDA was first introduced to write parallel programs in high-level languages for NVIDIA GPUs. While a GPU exploits data parallelism very effectively, task-level parallelism is ...
The Study on Application Value of EVA in Enterprise Performance Evaluation
ICEE '10: Proceedings of the 2010 International Conference on E-Business and E-GovernmentIn order to verify the application value of EVA in enterprise performance evaluation, in this paper, two sets of evaluation systems in which Traditional Accounting Earning and EVA were regarded as main performance indicators, were constructed on the ...






Comments