skip to main content
research-article
Open Access

Attributed Graph Rewriting for Complex Event Processing Self-Management

Published:20 September 2016Publication History
Skip Abstract Section

Abstract

The use of Complex Event Processing (CEP) and Stream Processing (SP) systems to process high-volume, high-velocity Big Data has renewed interest in procedures for managing these systems. In particular, self-management and adaptation of runtime platforms have been common research themes, as most of these systems run under dynamic conditions. Nevertheless, the research landscape in this area is still young and fragmented. Most research is performed in the context of specific systems, and it is difficult to generalize the results obtained to other contexts. To enable generic and reusable CEP/SP system management procedures and self-management policies, this research introduces the Attributed Graph Rewriting for Complex Event Processing Management (AGeCEP) formalism. AGeCEP represents queries in a language- and technology-agnostic fashion using attributed graphs. Query reconfiguration capabilities are expressed through standardized attributes, which are defined based on a novel classification of CEP query operators. By leveraging this representation, AGeCEP also proposes graph rewriting rules to define consistent reconfigurations of queries. To demonstrate AGeCEP feasibility, this research has used it to design an autonomic manager and to define a selected set of self-management policies. Finally, experiments demonstrate that AGeCEP can indeed be used to develop algorithms that can be integrated into diverse CEP systems.

References

  1. Daniel J. Abadi, Yanif Ahmad, Magdalena Balazinska, Mitch Cherniack, Jeong-Hyon Hwang, Wolfgang Lindner, Anurag S. Maskey, Er Rasin, Esther Ryvkina, Nesime Tatbul, Ying Xing, and Stan Zdonik. 2005. The design of the Borealis stream processing engine. In Proceedings of the 2nd Biennial Conference on Innovative Data Systems Research (CIDR’05). 277--289.Google ScholarGoogle Scholar
  2. Daniel J. Abadi, Don Carney, Ugur Çetintemel, Mitch Cherniack, Christian Convey, Sangdon Lee, Michael Stonebraker, Nesime Tatbul, and Stan Zdonik. 2003. Aurora: A new model and architecture for data stream management. Int. J. Very Large Data Bases 12, 2 (Aug. 2003), 120--139. DOI:http://dx.doi.org/10.1007/s00778-003-0095-z Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Yanif Ahmad and Ugur Çetintemel. 2004. Network-aware query processing for stream-based applications. In Proceedings of the 13th International Conference on Very Large Data Bases--Volume 30 (VLDB’04). VLDB Endowment, 456--467. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Mahdi Ben Alaya and Thierry Monteil. 2015. FRAMESELF: An ontology-based framework for the self-management of machine-to-machine systems. Concurr. Comput.: Pract. Exper. 27, 6 (2015), 1412--1426. DOI:http://dx.doi.org/10.1002/cpe.3168 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Amazon. 2015. Amazon Kinesis. Retrieved from http://aws.amazon.com/kinesis.Google ScholarGoogle Scholar
  6. Arvind Arasu, Brian Babcock, Shivnath Babu, John Cieslewicz, Mayur Datar, Keith Ito, Rajeev Motwani, Utkarsh Srivastava, and Jennifer Widom. 2004. STREAM: The Stanford Data Stream Management System. Technical Report 2004-20. Stanford InfoLab.Google ScholarGoogle Scholar
  7. Arvind Arasu, Shivnath Babu, and Jennifer Widom. 2005. The CQL continuous query language: Semantic foundations and query execution. VLDB J. 15, 2 (July 2005), 121--142. DOI:http://dx.doi.org/ 10.1007/s00778-004-0147-z Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Steve Awodey. 2006. Category Theory. Oxford Logic Guides, Vol. 49. Oxford University Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Damien Borgetto, Rodrigue Chakode, Benjamin Depardon, Cédric Eichler, Jean-Marie Garcia, Hassen Hbaieb, Thierry Monteil, Elie Pelorce, Anouar Rachdi, A. Al Sheikh, and Patricia Stolf. 2016. Hybrid approach for energy aware management of multi-cloud architecture integrating user machines. J. Grid Comput. 14, 1 (March 2016), 91--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Christian Y. A. Brenninkmeijer, Ixent Galpin, Alvaro A. A. Fernandes, and Norman W. Paton. 2008. A semantics for a query language over sensors, streams and relations. In Sharing Data, Information and Knowledge SE-9, Alex Gray, Keith Jeffery, and Jianhua Shao (Eds.). Lecture Notes in Computer Science, Vol. 5071. Springer Berlin Heidelberg, 87--99. DOI:http://dx.doi.org/10.1007/978-3-540-70504-8_9 Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Mitch Cherniack, Hari Balakrishnan, Magdalena Balazinska, Don Carney, Ugur Çetintemel, Ying Xing, and Stan Zdonik. 2003. Scalable distributed stream processing. In Proceedings of the 1st Biennial Conference on Innovative Data Systems Research (CIDR’03). 257--268.Google ScholarGoogle Scholar
  12. Gianpaolo Cugola and Alessandro Margara. 2010. TESLA: A formally defined event specification language. In Proceedings of the 4th ACM International Conference on Distributed Event-Based Systems (DEBS’10). ACM, New York, NY, 50. DOI:http://dx.doi.org/10.1145/1827418.1827427 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Gianpaolo Cugola and Alessandro Margara. 2012. Processing flows of information: From data stream to complex event processing. Comput. Surv. 44, 3 (June 2012), 1--62. DOI:http://dx.doi.org/10.1145/ 2187671.2187677 Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Gianpaolo Cugola, Alessandro Margara, Mauro Pezzè, and Matteo Pradella. 2015. Efficient analysis of event processing applications. In Proceedings of the 9th ACM International Conference on Distributed Event-Based Systems (DEBS’15). ACM, New York, NY, 10--21. DOI:http://dx.doi.org/10.1145/2675743.2771834 Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Alan J. Demers, Johannes Gehrke, Biswanath Panda, Mirek Riedewald, Varun Sharma, and Walker M. White. 2007. Cayuga: A general purpose event monitoring system. In Proceedings of the 3rd Biennial Conference on Innovative Data Systems Research (CIDR’07). 412--422.Google ScholarGoogle Scholar
  16. H. Ehrig, R. Heckel, M. Korff, M. Löwe, L. Ribeiro, A. Wagner, and A. Corradini. 1997. In Handbook of Graph Grammars and Computing by Graph Transformations, Volume 1: Foundations, Grzegorz Rozenberg (Ed.). World Scientific, Chapter Algebraic Approaches to Graph Transformation. Part II: Single Pushout Approach and Comparison with Double Pushout Approach, 247--312. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Cédric Eichler. 2015. Modélisation Formelle de Systèmes Dynamiques Autonomes: Graphe, Réécriture et Grammaire. Ph.D. Dissertation. Université Toulouse III.Google ScholarGoogle Scholar
  18. Cédric Eichler, Ghada Gharbi, Nawal Guermouche, Thierry Monteil, and Patricia Stolf. 2013. Graph-based formalism for machine-to-machine self-managed communications. In Proceedings of the 2013 IEEE 22nd International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises. 74--79. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Cédric Eichler, Thierry Monteil, Patricia Stolf, Luigi Alfredo Grieco, and Khalil Drira. 2016. Enhanced graph rewriting systems for complex software domains. Softw. Syst. Model. 15, 3 (July 2016), 685--705. DOI:http://dx.doi.org/10.1007/s10270-014-0433-1 Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. M. R. Garey and D. S. Johnson. 1979. Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Google. 2015. Google Cloud Dataflow. Retrieved from http://cloud.google.com/dataflow/.Google ScholarGoogle Scholar
  22. Katarina Grolinger, Michael Hayes, Wilson A. Higashino, Alexandra L’Heureux, David S. Allison, and Miriam A. M. Capretz. 2014. Challenges for MapReduce in big data. In Proceedings of the IEEE 10th 2014 World Congress on Services (SERVICES’14). Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Vincenzo Gulisano, Ricardo Jimenez-Peris, Marta Patino-Martinez, Claudio Soriente, and Patrick Valduriez. 2012. StreamCloud: An elastic and scalable data streaming system. IEEE Trans. Parallel Distrib. Syst. 23, 12 (Dec. 2012), 2351--2365. DOI:http://dx.doi.org/10.1109/TPDS.2012.24 Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Daniel Hagimont, Patricia Stolf, Laurent Broto, and Noel Palma. 2009. Autonomic Computing and Networking. Springer US, Boston, MA, Chapter Component-Based Autonomic Management for Legacy Software, 83--104. DOI:http://dx.doi.org/10.1007/978-0-387-89828-5_4Google ScholarGoogle Scholar
  25. Moustafa A. Hammad, Michael J. Franklin, Walid G. Aref, and Ahmed K. Elmagarmid. 2003. Scheduling for shared window joins over data streams. In Proceedings of the 29th International Conference on Very Large Data Bases-Volume 29. VLDB Endowment, 297--308. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Thomas Heinze, Zbigniew Jerzak, Gregor Hackenbroich, and Christof Fetzer. 2014. Latency-aware elastic scaling for distributed data stream processing systems. In Proceedings of the 8th ACM International Conference on Distributed Event-Based Systems (DEBS’14). ACM, New York, NY, 13--22. DOI:http://dx.doi.org/10.1145/2611286.2611294 Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Sebastian Herbst, Niko Pollner, Johannes Tenschert, Frank Lauterwald, Gregor Endler, and Klaus Meyer-Wegener. 2015. An algebra for pattern matching, time-aware aggregates and partitions on relational data streams. In Proceedings of the 9th ACM International Conference on Distributed Event-Based Systems (DEBS’15). ACM, New York, NY, 140--149. DOI:http://dx.doi.org/10.1145/2675743.2771830 Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Wilson A. Higashino, Miriam A. M. Capretz, and Luiz F. Bittencourt. 2016. CEPSim: Modelling and simulation of complex event processing systems in cloud environments. Fut. Gen. Comput. Syst. 65 (Dec. 2016), 122--139. DOI:http://dx.doi.org/10.1016/j.future.2015.10.023 Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Wilson A. Higashino, Cédric Eichler, Miriam A. M. Capretz, Thierry Monteil, Maria B. F. De Toledo, and Patricia Stolf. 2014. Query analyzer and manager for complex event processing as a service. In Proceedings of the 2014 IEEE 23rd International WETICE Conference. 107--109. DOI:http://dx.doi.org/ 10.1109/WETICE.2014.53 Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Mingsheng Hong, Mirek Riedewald, Christoph Koch, Johannes Gehrke, and Alan Demers. 2009. Rule-based multi-query optimization. In Proceedings of the 12th International Conference on Extending Database Technology Advances in Database Technology (EDBT’09). ACM, New York, NY, 120. DOI:http://dx.doi.org/10.1145/1516360.1516376 Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. IBM. 2006. An Architectural Blueprint for Autonomic Computing. Technical Report. IBM.Google ScholarGoogle Scholar
  32. Namit Jain, Shailendra Mishra, Anand Srinivasan, Johannes Gehrke, Jennifer Widom, Hari Balakrishnan, Ugur Çetintemel, Mitch Cherniack, Richard Tibbetts, and Stan Zdonik. 2008. Towards a streaming SQL standard. Proc. VLDB Endow. 1, 2 (Aug. 2008), 1379--1390. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. JBoss. 2016. Drools. Retrieved April 13, 2016 from http://www.drools.org.Google ScholarGoogle Scholar
  34. Jess. 2016. Jess, the Rule Engine for the Java Platform. (2016). Retrieved April 13rd, 2016 from http://www.jessrules.com/.Google ScholarGoogle Scholar
  35. J. O. Kephart and D. M. Chess. 2003. The vision of autonomic computing. Computer 36, 1 (Jan 2003), 41--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Jürgen Krämer and Bernhard Seeger. 2009. Semantics and implementation of continuous sliding window queries over data streams. ACM Trans. Database Syst. 34, 1 (2009), 1--49. DOI:http://dx.doi.org/ 10.1145/1508857.1508861 Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Geetika T. Lakshmanan, Ying Li, and Rob Strom. 2008. Placement strategies for internet-scale data stream systems. IEEE Internet Comput. 12, 6 (Nov. 2008), 50--60. DOI:http://dx.doi.org/10.1109/MIC.2008.129 Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Guoli Li and Hans-Arno Jacobsen. 2005. Composite subscriptions in content-based publish/subscribe systems. In Proceedings of the ACM/IFIP/USENIX 2005 International Conference on Middleware (Middleware’05). Springer-Verlag, New York, NY, 249--269. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Björn Lohrmann, Daniel Warneke, and Odej Kao. 2013. Nephele streaming: Stream processing under QoS constraints at scale. Cluster Comput. 17, 1 (July 2013), 61--78. DOI:http://dx.doi.org/ 10.1007/s10586-013-0281-8 Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Michael Löwe. 1993. Algebraic approach to single-pushout graph transformation. Theor. Comput. Sci. 109, 12 (1993), 181--224. DOI:http://dx.doi.org/10.1016/0304-3975(93)90068-5 Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. David Luckham. 2002. The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems (1st ed.). Addison-Wesley Professional. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. David Luckham and Roy Schulte. 2011. Event Processing Glossary—Version 2.0. Technical Report July. Event Processing Technical Society. 1--19 pages. Retrieved from http://www.complexevents.com/ 2011/08/23/event-processing-glossary-version-2/.Google ScholarGoogle Scholar
  43. Samuel Madden, Mehul Shah, Joseph M. Hellerstein, and Vijayshankar Raman. 2002. Continuously adaptive continuous queries over streams. In Proceedings of the 2002 ACM SIGMOD International Conference on Management of Data (SIGMOD’02). Vol. 13. ACM, New York, NY, 49. DOI:http://dx.doi.org/10.1145/564691.564698 Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Oracle. 2015. Oracle Stream Explorer. Retrieved October 31, 2015 from http://www.oracle.com/technetwork/middleware/complex-event-processing/overview/index.html.Google ScholarGoogle Scholar
  45. Peter Pietzuch, Jonathan Ledlie, Jeffrey Shneidman, Mema Roussopoulos, Matt Welsh, and Margo Seltzer. 2006. Network-aware operator placement for stream-processing systems. In Proceedings of the 22nd International Conference on Data Engineering (ICDE’06). IEEE, 49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Powersmiths. 2015. Powersmiths WOW - Build a more sustainable future. Retrieved October 28, 2015 from http://www.powersmithswow.com/.Google ScholarGoogle Scholar
  47. Zhengping Qian, Yong He, Chunzhi Su, Zhuojie Wu, Hongyu Zhu, Taizhi Zhang, Lidong Zhou, Yuan Yu, and Zheng Zhang. 2013. TimeStream: Reliable stream computation in the cloud. In Proceedings of the 8th ACM European Conference on Computer Systems. ACM Press, New York, NY, 1. DOI:http://dx.doi.org/10.1145/2465351.2465353 Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Ella Rabinovich, Opher Etzion, Sitvanit Ruah, and Sarit Archushin. 2010. Analyzing the behavior of event processing applications. In Proceedings of the 4th ACM International Conference on Distributed Event-Based Systems (DEBS’10). 223--234. DOI:http://dx.doi.org/10.1145/1827418.1827465 Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Ismael B. Rodriguez, Khalil Drira, Christophe Chassot, Karim Guennoun, and Mohamed Jmaiel. 2010. A rule-driven approach for architectural self adaptation in collaborative activities using graph grammars. Int. J. Auton. Comput. 1, 3 (2010), 226--245. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Grzegorz Rozenberg (Ed.). 1997. Handbook of Graph Grammars and Computing by Graph Transformations, Volume 1: Foundations. World Scientific. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Sergio Segura, David Benavides, Antonio Ruiz-Cortés, and Pablo Trinidad. 2008. Automated merging of feature models using graph transformations. In Generative and Transformational Techniques in Software Engineering II, Ralf Lämmel, Joost Visser, and João Saraiva (Eds.). Lecture Notes in Computer Science, Vol. 5235. Springer, Berlin, 489--505. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Guy Sharon and Opher Etzion. 2008. Event-processing network model and implementation. IBM Syst. J. 47, 2 (2008), 321--334. DOI:http://dx.doi.org/10.1147/sj.472.0321 Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Software AG. 2015. APAMA Streaming Analytics. Retrieved October 31, 2015 from http://www.softwareag.com/corporate/products/apama_webmethods/analytics/overview/.Google ScholarGoogle Scholar
  54. Storm. 2015. Storm: distributed and fault-tolerant realtime computation. Retrieved October 1, 2015 from http://storm-project.net/.Google ScholarGoogle Scholar
  55. Gabriele Taentzer. 2004. AGG: A graph transformation environment for modeling and validation of software. In Applications of Graph Transformations with Industrial Relevance, John L. Pfaltz, Manfred Nagl, and Boris Bhlen (Eds.). Lecture Notes in Computer Science, Vol. 3062. Springer, Berlin, 446--453.Google ScholarGoogle Scholar
  56. Matthias Weidlich, Jan Mendling, and Avigdor Gal. 2013. Net-based analysis of event processing networks the fast flower delivery case. In Application and Theory of Petri Nets and Concurrency SE-15, José-Manuel Colom and Jörg Desel (Eds.). Lecture Notes in Computer Science, Vol. 7927. Springer, Berlin, 270--290. DOI:http://dx.doi.org/10.1007/978-3-642-38697-8_15 Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Eugene Wu, Yanlei Diao, and Shariq Rizvi. 2006. High-performance complex event processing over streams. In Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data—SIGMOD’06, Vol. 10. ACM Press, New York, NY, 407. DOI:http://dx.doi.org/10.1145/1142473.1142520 Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Ying Xing, Stan Zdonik, and Jeong-hyon Hwang. 2005. Dynamic load distribution in the Borealis stream processor. In Proceedings of the 21st International Conference on Data Engineering (ICDE’05). IEEE, 791--802. DOI:http://dx.doi.org/10.1109/ICDE.2005.53 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Attributed Graph Rewriting for Complex Event Processing Self-Management

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader
            About Cookies On This Site

            We use cookies to ensure that we give you the best experience on our website.

            Learn more

            Got it!