Abstract
In this paper, we propose Stochastic Temporal Logic (StTL) as a formalism for expressing probabilistic specifications on time-varying behaviors of controlled stochastic dynamical systems. To make StTL a more effective specification formalism, we introduce the quantitative semantics for StTL to reason about the robust satisfaction of an StTL specification by a given system. Additionally, we propose using the robustness value as the objective function to be maximized by a stochastic optimization algorithm for the purpose of controller design. Finally, we formulate an algorithm for parameter inference for Parameteric-StTL specifications, which allows specifications to be mined from output traces of the underlying system. We demonstrate and validate our framework on two case studies inspired by the automotive domain.
- A. Abate, A. D’Innocenzo, and M. D. Di Benedetto. 2011. Approximate abstractions of stochastic hybrid systems. IEEE Trans. Automat. Control 56, 11 (Nov 2011), 2688--2694.Google Scholar
Cross Ref
- D. Aksaray, A. Jones, Z. Kong, M. Schwager, and C. Belta. 2016. Q-learning for robust satisfaction of signal temporal logic specifications. In IEEE 55th Conference on Decision and Control (CDC). 6565--6570.Google Scholar
- Matthias Althoff, Olaf Stursberg, and Martin Buss. 2009. Model-based probabilistic collision detection in autonomous driving. IEEE Transactions on Intelligent Transportation Systems 10 (2009), 299--310.Google Scholar
Digital Library
- Eugene Asarin, Alexandre Donzé, Oded Maler, and Dejan Nickovic. 2011. Parametric identification of temporal properties. In Proceedings of Runtime Verification. 147--160.Google Scholar
- Eugene Asarin and Oded Maler. 1998. Achilles and the tortoise climbing up the arithmetical hierarchy. J. Comput. System Sci. 57, 3 (1998), 389--398.Google Scholar
Digital Library
- Christel Baier, Marcus Größer, Martin Leucker, Benedikt Bollig, and Frank Ciesinski. 2004. Controller synthesis for probabilistic systems. In Exploring New Frontiers of Theoretical Informatics. Springer, 493--506.Google Scholar
- Alexey Bakhirkin, Thomas Ferrère, and Oded Maler. 2018. Efficient parametric identification for STL. In Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control. ACM, 177--186.Google Scholar
Digital Library
- Ezio Bartocci, Luca Bortolussi, Laura Nenzi, and Guido Sanguinetti. 2013. On the robustness of temporal properties for stochastic models. In Proceedings of the Second International Workshop on Hybrid Systems and Biology, HSB 2013, Taormina, Italy, 2nd September 2013.3--19.Google Scholar
Cross Ref
- Stephen Boyd and Lieven Vandenberghe. 2004. Convex Optimization. Cambridge University Press, New York, NY, USA.Google Scholar
Digital Library
- Tomáš Brázdil, Krishnendu Chatterjee, Martin Chmelík, Vojtěch Forejt, Jan Křetínský, Marta Kwiatkowska, David Parker, and Mateusz Ujma. 2014. Verification of Markov decision processes using learning algorithms. In Automated Technology for Verification and Analysis. 98--114.Google Scholar
- Chris Chatfield. 2016. The Analysis of Time Series: An Introduction. CRC press.Google Scholar
- Gang Chen, Zachary Sabato, and Zhaodan Kong. 2016. Active learning based requirement mining for cyber-physical systems. In IEEE 55th Conference on Decision and Control (CDC’16). 4586--4593.Google Scholar
Digital Library
- Edmund M Clarke and Paolo Zuliani. 2011. Statistical model checking for cyber-physical systems. In International Symposium on Automated Technology for Verification and Analysis. Springer, 1--12.Google Scholar
Digital Library
- Jyotirmoy V. Deshmukh, Panagiotis Kyriakis, and Paul Bogdan. 2018. Stochastic temporal logic abstractions: Challenges and opportunities. In International Conference on Formal Modeling and Analysis of Timed Systems. Springer, 3--16.Google Scholar
Cross Ref
- Jerry Ding, Maryam Kamgarpour, Sean Summers, Alessandro Abate, John Lygeros, and Claire Tomlin. 2013. A stochastic games framework for verification and control of discrete time stochastic hybrid systems. Automatica 49, 9 (2013), 2665--2674.Google Scholar
Digital Library
- Alexandre Donzé, Thomas Ferrère, and Oded Maler. 2013. Efficient robust monitoring for STL. In Proceedings of the 25th International Conference on Computer Aided Verification (Proceedings of Computer-Aided Verification’13). Springer-Verlag, Berlin, Heidelberg, 264--279.Google Scholar
Cross Ref
- Alexandre Donzé, Thomas Ferrère, and Oded Maler. 2013. Efficient robust monitoring for STL. In Proceedings of Computer-Aided Verification. 264--279.Google Scholar
Cross Ref
- Georgios E. Fainekos and George J. Pappas. 2009. Robustness of temporal logic specifications for continuous-time signals. Theoretical Computer Science 410, 42 (2009), 4262--4291.Google Scholar
Digital Library
- Jie Fu and Ufuk Topcu. 2015. Computational methods for stochastic control with metric interval temporal logic specifications. In Proceedings of the International Conference on Decision and Control (CDC). IEEE, 7440--7447.Google Scholar
Cross Ref
- Mahboobeh Ghorbani and Paul Bogdan. 2014. Reducing risk of closed loop control of blood glucose in artificial pancreas using fractional calculus. In Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE. IEEE, 4839--4842.Google Scholar
Cross Ref
- Hans Hansson and Bengt Jonsson. 1994. A logic for reasoning about time and reliability. Formal Aspects of Computing 6, 5 (1 Sep 1994), 512--535.Google Scholar
- Bardh Hoxha, Houssam Abbas, and Georgios Fainekos. 2015. Benchmarks for temporal logic requirements for automotive systems. In ARCH14-15. 1st and 2nd International Workshop on Applied veRification for Continuous and Hybrid Systems (EPiC Series in Computing), Goran Frehse and Matthias Althoff (Eds.), Vol. 34. EasyChair, 25--30.Google Scholar
- Bardh Hoxha, Adel Dokhanchi, and Georgios Fainekos. 2018. Mining parametric temporal logic properties in model-based design for cyber-physical systems. International Journal on Software Tools for Technology Transfer 20, 1 (2018), 79--93.Google Scholar
Digital Library
- Susmit Jha, Vasumathi Raman, Dorsa Sadigh, and Sanjit A. Seshia. 2018. Safe autonomy under perception uncertainty using chance-constrained temporal logic. J. Autom. Reason. 60, 1 (Jan. 2018), 43--62.Google Scholar
Digital Library
- Xiaoqing Jin, Jyotirmoy V. Deshmukh, James Kapinski, Koichi Ueda, and Ken Butts. 2014. Powertrain control verification benchmark. In Proceedings of the 17th International Conference on Hybrid Systems: Computation and Control. ACM, 253--262.Google Scholar
Digital Library
- Xiaoqing Jin, Alexandre Donzé, Jyotirmoy V. Deshmukh, and Sanjit A. Seshia. 2015. Mining requirements from closed-loop control models. IEEE Trans. Comp. Aided Design 34, 11 (2015), 1704--1717.Google Scholar
Digital Library
- Austin Jones, Zhaodan Kong, and Calin Belta. 2014. Anomaly detection in cyber-physical systems: A formal methods approach. In 53rd IEEE Conference on Decision and Control. IEEE, 848--853.Google Scholar
Cross Ref
- A. A. Julius and G. J. Pappas. 2009. Approximations of stochastic hybrid systems. IEEE Trans. Automat. Control 54, 6 (June 2009), 1193--1203.Google Scholar
Cross Ref
- M. Kamgarpour, J. Ding, S. Summers, A. Abate, J. Lygeros, and C. Tomlin. 2011. Discrete time stochastic hybrid dynamical games: Verification 8 controller synthesis. In 2011 50th IEEE Conference on Decision and Control and European Control Conference. 6122--6127.Google Scholar
- J. Kapinski, X. Jin, J. Deshmukh, A. Donzé, T. Yamaguchi, H. Ito, T. Kaga, S. Kobuna, and S. A. Seshia. 2016. ST-Lib: A library for specifying and classifying model behaviors. In SAE Technical Paper. SAE.Google Scholar
- Zhaodan Kong, Austin Jones, Ana Medina Ayala, Ebru Aydin Gol, and Calin Belta. 2014. Temporal logic inference for classification and prediction from data. In Proceedings of the 17th International Conference on Hybrid Systems: Computation and Control. ACM, 273--282.Google Scholar
Digital Library
- M. Lahijanian, S. B. Andersson, and C. Belta. 2011. Control of Markov decision processes from PCTL specifications. In Proceedings of the 2011 American Control Conference. 311--316.Google Scholar
- Axel Legay, Benoît Delahaye, and Saddek Bensalem. 2010. Statistical model checking: An overview. In International Conference on Runtime Verification. Springer, 122--135.Google Scholar
Digital Library
- Julien Legriel, Colas Le Guernic, Scott Cotton, and Oded Maler. 2010. Approximating the pareto front of multi-criteria optimization problems. In Proceedings of TACAS. 69--83.Google Scholar
Digital Library
- Jiwei Li, Pierluigi Nuzzo, Alberto Sangiovanni-Vincentelli, Yugeng Xi, and Dewei Li. 2017. Stochastic contracts for cyber-physical system design under probabilistic requirements. In ACM/IEEE Int. Conf. on Formal Methods and Models for System Design.Google Scholar
Digital Library
- Oded Maler. 2017. Learning Monotone Partitions of Partially-Ordered Domains (Work in Progress). (July 2017). https://hal.archives-ouvertes.fr/hal-01556243 working paper or preprint.Google Scholar
- Oded Maler and Dejan Nickovic. 2004. Monitoring temporal properties of continuous signals. In Proceedings of FORMATS/FTRTFT. 152--166.Google Scholar
Cross Ref
- Aurélien Rizk, Grégory Batt, François Fages, and Sylvain Soliman. 2008. On a continuous degree of satisfaction of temporal logic formulae with applications to systems biology. In Computational Methods in Systems Biology, Monika Heiner and Adelinde M. Uhrmacher (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 251--268.Google Scholar
- Hendrik Roehm, Rainer Gmehlich, Thomas Heinz, Jens Oehlerking, and Matthias Woehrle. 2015. Industrial examples of formal specifications for test case generation. In Workshop on Applied veRification for Continuous and Hybrid Systems, [email protected] 2015. 80--88.Google Scholar
- Dorsa Sadigh and Ashish Kapoor. 2016. Safe control under uncertainty with probabilistic signal temporal logic. In Robotics Science and Systems.Google Scholar
- Yuhui Shi and Russell C. Eberhart. 1998. Parameter selection in particle swarm optimization. In Evolutionary Programming VII, V. W. Porto, N. Saravanan, D. Waagen, and A. E. Eiben (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 591--600.Google Scholar
- Bernard W. Silverman. 1986. Density Estimation for Statistics and Data Analysis. Vol. 26. CRC press.Google Scholar
- R. Verma, D. D. Vecchio, and H. K. Fathy. 2008. Development of a scaled vehicle with longitudinal dynamics of an HMMWV for an ITS testbed. IEEE/ASME Transactions on Mechatronics 13, 1 (Feb 2008), 46--57. DOI:https://doi.org/10.1109/TMECH.2008.915820Google Scholar
Cross Ref
- Yuankun Xue and Paul Bogdan. 2017. Constructing compact causal mathematical models for complex dynamics. In Proceedings of the 8th International Conference on Cyber-Physical Systems (ICCPS’17). 97--107.Google Scholar
Digital Library
- Xiaobin Zhang, Bo Wu, and Hai Lin. 2015. Learning based supervisor synthesis of pomdp for pctl specifications. In IEEE 54th Annual Conference on Decision and Control (CDC’15). IEEE, 7470--7475.Google Scholar
Cross Ref
Index Terms
Specification Mining and Robust Design under Uncertainty: A Stochastic Temporal Logic Approach
Recommendations
Discrete event process controller synthesis using VDM/sup ++/
ICECCS '95: Proceedings of the 1st International Conference on Engineering of Complex Computer SystemsThe paper describes approaches to the specification and design of a controller for a gas burner system using VDM/sup ++/. It defines a systematic method for interpreting declarative requirements statements in real-time temporal logic, and for the ...
Design and Implementation of a Tool for Specifying Specification in SOFL
Revised Selected Papers of the Second International Workshop on Structured Object-Oriented Formal Language and Method - Volume 7787Structure Object-oriented Formal Language SOFL is not just a formal language for writing formal specification. It is also an approach and a methodology. SOFL provides a three-step approach for modelling a software system using formal specification. ...
Formal Specification and Design Time Testing
It is shown how design time testing can be used in conjunction with formal specification. Emphasis is placed on the benefits of using an executable specification language OBJ, of having a design controlled by requirements specification, and of adherence ...






Comments