Abstract
We present a scalable methodology to verify stochastic hybrid systems for inequality linear temporal logic (iLTL) or inequality metric interval temporal logic (iMITL). Using the Mori–Zwanzig reduction method, we construct a finite-state Markov chain reduction of a given stochastic hybrid system and prove that this reduced Markov chain is approximately equivalent to the original system in a distributional sense. Approximate equivalence of the stochastic hybrid system and its Markov chain reduction means that analyzing the Markov chain with respect to a suitably strengthened property allows us to conclude whether the original stochastic hybrid system meets its temporal logic specifications. Based on this, we propose the first statistical model checking algorithms to verify stochastic hybrid systems against correctness properties, expressed in iLTL or iMITL. The scalability of the proposed algorithms is demonstrated by a case study.
- [1] . Retrieved June 10, 2019 from https://commons.apache.org/proper/commons-math.Google Scholar
- [2] . 2011. Approximate Abstractions of Stochastic Hybrid Systems. IEEE Transactions on Automatic Control 56, 11 (2011), 2688–2694.Google Scholar
Cross Ref
- [3] . 2010. Approximate Model Checking of Stochastic Hybrid Systems. European Journal of Control 16, 6 (2010), 624–641.Google Scholar
Cross Ref
- [4] . 2014. Probabilistic model checking of labelled Markov processes via finite approximate bisimulations. In Proceedings of the Horizons of the Mind. A Tribute to Prakash Panangaden. Springer, 40–58.Google Scholar
Cross Ref
- [5] . 2015. Quantitative approximation of the probability distribution of a Markov process by formal abstractions. Logical Methods in Computer Science 11, 3 (2015), 1–29.Google Scholar
- [6] . 2013. Testing closeness of discrete distributions. Journal of the ACM 60, 1 (2013), 1–25. Google Scholar
Digital Library
- [7] . 2003. Counter-Example Guided Predicate Abstraction of Hybrid Systems. In Proceedings of the International Conference on Tools and Algorithms for the Construction and Analysis of Systems. 208–223. Google Scholar
Digital Library
- [8] . 1994. A theory of timed automata. Theoretical Computer Science 126, 2 (
April 1994), 183–235. Google ScholarDigital Library
- [9] . 1996. The benefits of relaxing punctuality. Journal of the ACM 43, 1 (1996), 116–146. Google Scholar
Digital Library
- [10] . 2000. Model checking continuous-time Markov chains by transient analysis. In Proceedings of the International Conference on Computer Aided Verification. Springer, 358–372. Google Scholar
Digital Library
- [11] . 2013. Testing closeness of discrete distributions. Journal of the ACM 60, 1 (
Feb. 2013), Article 4, 25 pages. Google ScholarDigital Library
- [12] . 2009. Model reduction, optimal prediction, and the Mori-Zwanzig representation of Markov chains. In Proceedings of the 48th IEEE Conference on Decision and Control held jointly with 2009 28th Chinese Control Conference. 3282–3287.Google Scholar
Cross Ref
- [13] . 2018. Stochastic Hybrid Systems. CRC Press.Google Scholar
Cross Ref
- [14] . 2010. A Counterexample Guided Abstraction-Refinement Framework for Markov Decision Processes. ACM Transactions on Computational Logic 12, 1 (2010), 1:1–1:49. Google Scholar
Digital Library
- [15] . 2000. Optimal prediction and the Mori-Zwanzig representation of irreversible processes. Proceedings of the National Academy of Sciences 97, 7 (2000), 2968–2973.Google Scholar
Cross Ref
- [16] . 1965. On the asymptotic theory of fixed-width sequential confidence intervals for the mean. The Annals of Mathematical Statistics 36, 2 (1965), 457–462.Google Scholar
Cross Ref
- [17] . 2003. Abstraction and Counterexample-Guided Refinement in Model Checking of Hybrid Systems. International Journal of Foundations of Computer Science 14, 4 (2003), 583–604.Google Scholar
Cross Ref
- [18] . 2018. Handbook of Model Checking. Springer. Google Scholar
Digital Library
- [19] . 2018. Abstraction and abstraction refinement. In Proceedings of the Handbook of Model Checking. Springer, 385–419.Google Scholar
Cross Ref
- [20] . 2012. Statistical model checking for stochastic hybrid systems. arXiv:1208.3856. Retrieved from https://arxiv.org/abs/1208.3856.Google Scholar
- [21] . 1999. On the approximation of complicated dynamical behavior. SIAM Journal on Numerical Analysis 36, 2 (1999), 491–515. Google Scholar
Digital Library
- [22] . 2002. Bisimulation for labelled Markov processes. Information and Computation 179, 2 (2002), 163–193. Google Scholar
Digital Library
- [23] . 2013. A Course in Robust Control Theory: A Convex Approach. Springer Science & Business Media.Google Scholar
- [24] . 2011. LTL translation improvements in spot. In Proceedings of the 5th International Conference on Verification and Evaluation of Computer and Communication Systems. British Computer Society, Swinton, 72–83. Google Scholar
Digital Library
- [25] . 2004. SPOT: An extensible model checking library using transition-based generalized büchi automata. In Proceedings of the IEEE Computer Society’s 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems. IEEE Computer Society, 76–83. Google Scholar
Digital Library
- [26] . 2013. Adaptive and sequential gridding procedures for the abstraction and verification of stochastic processes. SIAM Journal on Applied Dynamical Systems 12, 2 (2013), 921–956.Google Scholar
Cross Ref
- [27] . 2011. Measurability and safety verification for stochastic hybrid systems. In Proceedings of the 14th International Conference on Hybrid Systems: Computation and Control. 43–52. Google Scholar
Digital Library
- [28] . 2001. Fast LTL to BüChi automata translation. In Proceedings of the 13th International Conference on Computer Aided Verification. Springer-Verlag, London, 53–65. Google Scholar
Digital Library
- [29] . 2010. Approximately bisimilar symbolic models for incrementally stable switched systems. IEEE Transactions on Automatic Control 55, 1 (2010), 116–126.Google Scholar
Cross Ref
- [30] . 2015. Approximate probabilistic verification of hybrid systems. In Proceedings of the Hybrid Systems Biology. Springer, 96–116.Google Scholar
Cross Ref
- [31] . 2017. Verification of general Markov decision processes by approximate similarity relations and policy refinement. SIAM Journal on Control and Optimization 55, 4 (2017), 2333–2367.Google Scholar
Cross Ref
- [32] . 2007. Applied Stochastic Processes and Control for Jump-Diffusions: Modeling, Analysis and Computation. Society for Industrial and Applied Mathematics (2007), 29. Google Scholar
Digital Library
- [33] . 1994. A logic for reasoning about time and reliability. Formal Aspects of Computing 6, 5 (1994), 512–535.Google Scholar
Digital Library
- [34] . 2005. Stochastic models for chemically reacting systems using polynomial stochastic hybrid systems. International Journal of Robust and Nonlinear Control: IFAC-Affiliated Journal 15, 15 (2005), 669–689.Google Scholar
Cross Ref
- [35] . 2000. Towards a theory of stochastic hybrid systems. In Proceedings of the International Workshop on Hybrid Systems: Computation and Control. Springer, 160–173. Google Scholar
Digital Library
- [36] . 2004. Modeling subtilin production in bacillus subtilis using stochastic hybrid systems. In Proceedings of the International Workshop on Hybrid Systems: Computation and Control. Springer, 417–431.Google Scholar
Cross Ref
- [37] . 2009. A bayesian approach to model checking biological systems. In Proceedings of the International Conference on Computational Methods in Systems Biology. Springer, 218–234. Google Scholar
Digital Library
- [38] . 2014. Benchmarks for model transformations and conformance checking. In Proceedings of the 1st International Workshop on Applied Verification for Continuous and Hybrid Systems.Google Scholar
- [39] . 2009. Approximations of Stochastic Hybrid Systems. IEEE Transactions on Automatic Control 54, 6 (2009), 1193–1203.Google Scholar
Cross Ref
- [40] . 2012. Brownian Motion and Stochastic Calculus. Vol. 113. Springer Science & Business Media.Google Scholar
- [41] . 2008. A fully automated framework for control of linear systems from temporal logic specifications. IEEE Transactions on Automatic Control 53, 1 (
Feb. 2008), 287–297.Google ScholarCross Ref
- [42] . 2008. Computational methods for verification of stochastic hybrid systems. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 38, 2 (2008), 385–396. Google Scholar
Digital Library
- [43] . 2004. Linear Inequality LTL (iLTL): A model checker for discrete time markov chains. In Proceedings of the Formal Methods and Software Engineering. , , and (Eds.).
Lecture Notes in Computer Science , Vol. 3308. Springer, Berlin, 194–208.Google ScholarCross Ref
- [44] . 2011. Verifying the evolution of probability distributions governed by a DTMC. IEEE Transactions on Software Engineering 37, 1 (2011), 126–141. Google Scholar
Digital Library
- [45] . 2021. Automated verification and synthesis of stochastic hybrid systems: A survey. https://arxiv.org/abs/2101.07491. Preprint.Google Scholar
- [46] . 2017. Introduction to Embedded Systems: A Cyber-Physical Systems Approach. Mit Press.Google Scholar
- [47] . 2010. Statistical model checking: An overview. In Proceedings of the International Conference on Runtime Verification. Springer, 122–135. Google Scholar
Digital Library
- [48] . 2015. Statistical Model Checking: Challenges and Perspectives. Springer Google Scholar
Digital Library
- [49] . 2012. Approximate probabilistic analysis of biopathway dynamics. Bioinformatics 28, 11 (2012), 1508–1516. Google Scholar
Digital Library
- [50] . 2011. Probabilistic approximations of ODEs based bio-pathway dynamics. Theoretical Computer Science 412, 21 (2011), 2188–2206. Google Scholar
Digital Library
- [51] . 2013. Synthesis of reactive switching protocols from temporal logic specifications. IEEE Transactions on Automatic Control 58, 7 (2013), 1771–1785.Google Scholar
Cross Ref
- [52] . 1977. The temporal logic of programs. In Proceedings of the 18th Annual Symposium on Foundations of Computer Science. IEEE, 46–57. Google Scholar
Digital Library
- [53] . 2008. Approximately bisimilar symbolic models for nonlinear control systems. Automatica 44, 10 (2008), 2508–2516. Google Scholar
Digital Library
- [54] . 2013. Continuous Martingales and Brownian Motion. Vol. 293. Springer Science & Business Media.Google Scholar
- [55] . 2013. Monte Carlo Statistical Methods. Springer Science & Business Media.Google Scholar
- [56] . 2017. HARE: A Hybrid Abstraction Refinement Engine for verifying non-linear hybrid automata. In Proceedings of the International Conference on Tools and Algorithms for the Construction and Analysis of Systems. 573–588. Springer, Berlin. Google Scholar
Digital Library
- [57] . 2018. Revisiting MITL to fix decision procedures. In Proceedings of the International Conference on Verification, Model Checking, and Abstract Interpretation. Springer, 474–494.Google Scholar
Cross Ref
- [58] . 2017. Statistical verification of the Toyota powertrain control verification benchmark. In Proceedings of the 20th International Conference on Hybrid Systems: Computation and Control. 65–70. Google Scholar
Digital Library
- [59] . 2005. On statistical model checking of stochastic systems. In Proceedings of the Computer Aided Verification. and (Eds.). Number 3576 in
Lecture Notes in Computer Science . Springer, Berlin, 266–280. Google ScholarDigital Library
- [60] . 2010. Stochastic hybrid systems for studying biochemical processes. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 368, 1930 (2010), 4995–5011.Google Scholar
Cross Ref
- [61] . 1985. The complexity of propositional linear temporal logics. Journal of the ACM 32, 3 (1985), 733–749.
DOI: https://doi.org/10.1145/3828.3837 Google ScholarDigital Library
- [62] . 2017. Multilevel monte carlo method for statistical model checking of hybrid systems. In Proceedings of the International Conference on Quantitative Evaluation of Systems. Springer, 351–367.Google Scholar
Cross Ref
- [63] . 2012. Modeling and simulation of a microgrid as a stochastic hybrid system. In Proceedings of the 2012 3rd IEEE PES Innovative Smart Grid Technologies Europe. IEEE, 1–9.Google Scholar
Cross Ref
- [64] . 2017. Robust global recurrence for a class of stochastic hybrid systems. Nonlinear Analysis: Hybrid Systems 25 (2017), 283–297.Google Scholar
Cross Ref
- [65] . 2010. Verification of discrete time stochastic hybrid systems: A stochastic reach-avoid decision problem. Automatica 46, 12 (2010), 1951–1961. Google Scholar
Digital Library
- [66] . 2006. Linear time logic control of discrete-time linear systems. IEEE Transactions on Automatic Control 51, 12 (2006), 1862–1877.Google Scholar
Cross Ref
- [67] . 2017. Recent Developments in Stability Theory for Stochastic Hybrid Inclusions. Springer International Publishing, Cham, 329–354.Google Scholar
- [68] . 2015. Stochastic hybrid systems: A modeling and stability theory tutorial. In Proceedings of the 2015 IEEE 54th Annual Conference on Decision and Control. IEEE, 3116–3136.Google Scholar
Cross Ref
- [69] . 2014. Stability analysis for stochastic hybrid systems: A survey. Automatica 50, 10 (2014), 2435–2456. Google Scholar
Digital Library
- [70] . 2013. Formula-free finite abstractions for linear temporal verification of stochastic hybrid systems. In Proceedings of the 16th International Conference on Hybrid Systems: Computation and Control. ACM, 283–292. Google Scholar
Digital Library
- [71] . 2013. Quantitative automata-based controller synthesis for non-autonomous stochastic hybrid systems. In Proceedings of the 16th International Conference on Hybrid Systems: Computation and Control. ACM, 293–302. Google Scholar
Digital Library
- [72] . 1945. Sequential tests of statistical hypotheses. The Annals of Mathematical Statistics 16, 2 (1945), 117–186.Google Scholar
Cross Ref
- [73] . 2015. A Mori-Zwanzig and MITL based approach to statistical verification of continuous-time dynamical systems. IFAC-PapersOnLine 48, 27 (2015), 267–273.Google Scholar
Cross Ref
- [74] . 2015. Statistical verification of dynamical systems using set oriented methods. In Proceedings of the 18th International Conference on Hybrid Systems: Computation and Control. ACM, 169–178. Google Scholar
Digital Library
- [75] . 2016. Verifying Continuous-time Stochastic Hybrid Systems via Mori-Zwanzig model reduction. In Proceedings of the 2016 IEEE 55th Conference on Decision and Control. IEEE, 3012–3017.Google Scholar
Digital Library
- [76] . 2010. Receding horizon control for temporal logic specifications. In Proceedings of the 13th ACM International Conference on Hybrid Systems: Computation and Control. ACM, New York, NY, 101–110. Google Scholar
Digital Library
- [77] . 2006. Error control for probabilistic model checking. In Proceedings of the 7th International Conference on Verification, Model Checking, and Abstract Interpretation. 142–156. Google Scholar
Digital Library
- [78] . 2006. Statistical probabilistic model checking with a focus on time-bounded properties. Information and Computation 204, 9 (2006), 1368–1409. Google Scholar
Digital Library
- [79] . 2014. Symbolic control of stochastic systems via approximately bisimilar finite abstractions. IEEE Transactions on Automatic Control 59, 12 (2014), 3135–3150.Google Scholar
Cross Ref
- [80] . 2012. Symbolic models for nonlinear control systems without stability assumptions. IEEE Transactions on Automatic Control 57, 7 (2012), 1804–1809.Google Scholar
Cross Ref
- [81] . 2012. Rare-event verification for stochastic hybrid systems. In Proceedings of the 15th ACM International Conference on Hybrid Systems: Computation and Control. 217–226. Google Scholar
Digital Library
- [82] . 2010. Bayesian statistical model checking with application to simulink/stateflow verification. In Proceedings of the 13th ACM International Conference on Hybrid systems: Computation and Control. 243–252. Google Scholar
Digital Library
Index Terms
Verifying Stochastic Hybrid Systems with Temporal Logic Specifications via Model Reduction
Recommendations
Verifying cyber-physical systems by combining software model checking with hybrid systems reachability
EMSOFT '16: Proceedings of the 13th International Conference on Embedded SoftwareCyber-physical systems (CPS) span the communication, computation and control domains. Creating a single, complete, and detailed model of a CPS is not only difficult, but, in terms of verification, probably not useful; current verification algorithms are ...
Model Conformance for Cyber-Physical Systems: A Survey
Special Issue on Real Time Aspects in CPS and Regular Papers (Diamonds)Model-based development is an important paradigm for developing cyber-physical systems (CPS). The underlying assumption is that the functional behavior of a model is related to the behavior of a more concretized model or the real system. A formal ...
Statistical model checking for stochastic hybrid systems involving nondeterminism over continuous domains
Behavioral verification of technical systems involving both discrete and continuous components is a common and demanding task. The behavior of such systems can often be characterized using stochastic hybrid automata, leading to verification problems ...






Comments