Abstract
The use of Complex Event Processing (CEP) and Stream Processing (SP) systems to process high-volume, high-velocity Big Data has renewed interest in procedures for managing these systems. In particular, self-management and adaptation of runtime platforms have been common research themes, as most of these systems run under dynamic conditions. Nevertheless, the research landscape in this area is still young and fragmented. Most research is performed in the context of specific systems, and it is difficult to generalize the results obtained to other contexts. To enable generic and reusable CEP/SP system management procedures and self-management policies, this research introduces the Attributed Graph Rewriting for Complex Event Processing Management (AGeCEP) formalism. AGeCEP represents queries in a language- and technology-agnostic fashion using attributed graphs. Query reconfiguration capabilities are expressed through standardized attributes, which are defined based on a novel classification of CEP query operators. By leveraging this representation, AGeCEP also proposes graph rewriting rules to define consistent reconfigurations of queries. To demonstrate AGeCEP feasibility, this research has used it to design an autonomic manager and to define a selected set of self-management policies. Finally, experiments demonstrate that AGeCEP can indeed be used to develop algorithms that can be integrated into diverse CEP systems.
- Daniel J. Abadi, Yanif Ahmad, Magdalena Balazinska, Mitch Cherniack, Jeong-Hyon Hwang, Wolfgang Lindner, Anurag S. Maskey, Er Rasin, Esther Ryvkina, Nesime Tatbul, Ying Xing, and Stan Zdonik. 2005. The design of the Borealis stream processing engine. In Proceedings of the 2nd Biennial Conference on Innovative Data Systems Research (CIDR’05). 277--289.Google Scholar
- Daniel J. Abadi, Don Carney, Ugur Çetintemel, Mitch Cherniack, Christian Convey, Sangdon Lee, Michael Stonebraker, Nesime Tatbul, and Stan Zdonik. 2003. Aurora: A new model and architecture for data stream management. Int. J. Very Large Data Bases 12, 2 (Aug. 2003), 120--139. DOI:http://dx.doi.org/10.1007/s00778-003-0095-z Google Scholar
Digital Library
- Yanif Ahmad and Ugur Çetintemel. 2004. Network-aware query processing for stream-based applications. In Proceedings of the 13th International Conference on Very Large Data Bases--Volume 30 (VLDB’04). VLDB Endowment, 456--467. Google Scholar
Digital Library
- Mahdi Ben Alaya and Thierry Monteil. 2015. FRAMESELF: An ontology-based framework for the self-management of machine-to-machine systems. Concurr. Comput.: Pract. Exper. 27, 6 (2015), 1412--1426. DOI:http://dx.doi.org/10.1002/cpe.3168 Google Scholar
Digital Library
- Amazon. 2015. Amazon Kinesis. Retrieved from http://aws.amazon.com/kinesis.Google Scholar
- Arvind Arasu, Brian Babcock, Shivnath Babu, John Cieslewicz, Mayur Datar, Keith Ito, Rajeev Motwani, Utkarsh Srivastava, and Jennifer Widom. 2004. STREAM: The Stanford Data Stream Management System. Technical Report 2004-20. Stanford InfoLab.Google Scholar
- Arvind Arasu, Shivnath Babu, and Jennifer Widom. 2005. The CQL continuous query language: Semantic foundations and query execution. VLDB J. 15, 2 (July 2005), 121--142. DOI:http://dx.doi.org/ 10.1007/s00778-004-0147-z Google Scholar
Digital Library
- Steve Awodey. 2006. Category Theory. Oxford Logic Guides, Vol. 49. Oxford University Press. Google Scholar
Digital Library
- Damien Borgetto, Rodrigue Chakode, Benjamin Depardon, Cédric Eichler, Jean-Marie Garcia, Hassen Hbaieb, Thierry Monteil, Elie Pelorce, Anouar Rachdi, A. Al Sheikh, and Patricia Stolf. 2016. Hybrid approach for energy aware management of multi-cloud architecture integrating user machines. J. Grid Comput. 14, 1 (March 2016), 91--108. Google Scholar
Digital Library
- Christian Y. A. Brenninkmeijer, Ixent Galpin, Alvaro A. A. Fernandes, and Norman W. Paton. 2008. A semantics for a query language over sensors, streams and relations. In Sharing Data, Information and Knowledge SE-9, Alex Gray, Keith Jeffery, and Jianhua Shao (Eds.). Lecture Notes in Computer Science, Vol. 5071. Springer Berlin Heidelberg, 87--99. DOI:http://dx.doi.org/10.1007/978-3-540-70504-8_9 Google Scholar
Digital Library
- Mitch Cherniack, Hari Balakrishnan, Magdalena Balazinska, Don Carney, Ugur Çetintemel, Ying Xing, and Stan Zdonik. 2003. Scalable distributed stream processing. In Proceedings of the 1st Biennial Conference on Innovative Data Systems Research (CIDR’03). 257--268.Google Scholar
- Gianpaolo Cugola and Alessandro Margara. 2010. TESLA: A formally defined event specification language. In Proceedings of the 4th ACM International Conference on Distributed Event-Based Systems (DEBS’10). ACM, New York, NY, 50. DOI:http://dx.doi.org/10.1145/1827418.1827427 Google Scholar
Digital Library
- Gianpaolo Cugola and Alessandro Margara. 2012. Processing flows of information: From data stream to complex event processing. Comput. Surv. 44, 3 (June 2012), 1--62. DOI:http://dx.doi.org/10.1145/ 2187671.2187677 Google Scholar
Digital Library
- Gianpaolo Cugola, Alessandro Margara, Mauro Pezzè, and Matteo Pradella. 2015. Efficient analysis of event processing applications. In Proceedings of the 9th ACM International Conference on Distributed Event-Based Systems (DEBS’15). ACM, New York, NY, 10--21. DOI:http://dx.doi.org/10.1145/2675743.2771834 Google Scholar
Digital Library
- Alan J. Demers, Johannes Gehrke, Biswanath Panda, Mirek Riedewald, Varun Sharma, and Walker M. White. 2007. Cayuga: A general purpose event monitoring system. In Proceedings of the 3rd Biennial Conference on Innovative Data Systems Research (CIDR’07). 412--422.Google Scholar
- H. Ehrig, R. Heckel, M. Korff, M. Löwe, L. Ribeiro, A. Wagner, and A. Corradini. 1997. In Handbook of Graph Grammars and Computing by Graph Transformations, Volume 1: Foundations, Grzegorz Rozenberg (Ed.). World Scientific, Chapter Algebraic Approaches to Graph Transformation. Part II: Single Pushout Approach and Comparison with Double Pushout Approach, 247--312. Google Scholar
Digital Library
- Cédric Eichler. 2015. Modélisation Formelle de Systèmes Dynamiques Autonomes: Graphe, Réécriture et Grammaire. Ph.D. Dissertation. Université Toulouse III.Google Scholar
- Cédric Eichler, Ghada Gharbi, Nawal Guermouche, Thierry Monteil, and Patricia Stolf. 2013. Graph-based formalism for machine-to-machine self-managed communications. In Proceedings of the 2013 IEEE 22nd International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises. 74--79. Google Scholar
Digital Library
- Cédric Eichler, Thierry Monteil, Patricia Stolf, Luigi Alfredo Grieco, and Khalil Drira. 2016. Enhanced graph rewriting systems for complex software domains. Softw. Syst. Model. 15, 3 (July 2016), 685--705. DOI:http://dx.doi.org/10.1007/s10270-014-0433-1 Google Scholar
Digital Library
- M. R. Garey and D. S. Johnson. 1979. Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman. Google Scholar
Digital Library
- Google. 2015. Google Cloud Dataflow. Retrieved from http://cloud.google.com/dataflow/.Google Scholar
- Katarina Grolinger, Michael Hayes, Wilson A. Higashino, Alexandra L’Heureux, David S. Allison, and Miriam A. M. Capretz. 2014. Challenges for MapReduce in big data. In Proceedings of the IEEE 10th 2014 World Congress on Services (SERVICES’14). Google Scholar
Digital Library
- Vincenzo Gulisano, Ricardo Jimenez-Peris, Marta Patino-Martinez, Claudio Soriente, and Patrick Valduriez. 2012. StreamCloud: An elastic and scalable data streaming system. IEEE Trans. Parallel Distrib. Syst. 23, 12 (Dec. 2012), 2351--2365. DOI:http://dx.doi.org/10.1109/TPDS.2012.24 Google Scholar
Digital Library
- Daniel Hagimont, Patricia Stolf, Laurent Broto, and Noel Palma. 2009. Autonomic Computing and Networking. Springer US, Boston, MA, Chapter Component-Based Autonomic Management for Legacy Software, 83--104. DOI:http://dx.doi.org/10.1007/978-0-387-89828-5_4Google Scholar
- Moustafa A. Hammad, Michael J. Franklin, Walid G. Aref, and Ahmed K. Elmagarmid. 2003. Scheduling for shared window joins over data streams. In Proceedings of the 29th International Conference on Very Large Data Bases-Volume 29. VLDB Endowment, 297--308. Google Scholar
Digital Library
- Thomas Heinze, Zbigniew Jerzak, Gregor Hackenbroich, and Christof Fetzer. 2014. Latency-aware elastic scaling for distributed data stream processing systems. In Proceedings of the 8th ACM International Conference on Distributed Event-Based Systems (DEBS’14). ACM, New York, NY, 13--22. DOI:http://dx.doi.org/10.1145/2611286.2611294 Google Scholar
Digital Library
- Sebastian Herbst, Niko Pollner, Johannes Tenschert, Frank Lauterwald, Gregor Endler, and Klaus Meyer-Wegener. 2015. An algebra for pattern matching, time-aware aggregates and partitions on relational data streams. In Proceedings of the 9th ACM International Conference on Distributed Event-Based Systems (DEBS’15). ACM, New York, NY, 140--149. DOI:http://dx.doi.org/10.1145/2675743.2771830 Google Scholar
Digital Library
- Wilson A. Higashino, Miriam A. M. Capretz, and Luiz F. Bittencourt. 2016. CEPSim: Modelling and simulation of complex event processing systems in cloud environments. Fut. Gen. Comput. Syst. 65 (Dec. 2016), 122--139. DOI:http://dx.doi.org/10.1016/j.future.2015.10.023 Google Scholar
Digital Library
- Wilson A. Higashino, Cédric Eichler, Miriam A. M. Capretz, Thierry Monteil, Maria B. F. De Toledo, and Patricia Stolf. 2014. Query analyzer and manager for complex event processing as a service. In Proceedings of the 2014 IEEE 23rd International WETICE Conference. 107--109. DOI:http://dx.doi.org/ 10.1109/WETICE.2014.53 Google Scholar
Digital Library
- Mingsheng Hong, Mirek Riedewald, Christoph Koch, Johannes Gehrke, and Alan Demers. 2009. Rule-based multi-query optimization. In Proceedings of the 12th International Conference on Extending Database Technology Advances in Database Technology (EDBT’09). ACM, New York, NY, 120. DOI:http://dx.doi.org/10.1145/1516360.1516376 Google Scholar
Digital Library
- IBM. 2006. An Architectural Blueprint for Autonomic Computing. Technical Report. IBM.Google Scholar
- Namit Jain, Shailendra Mishra, Anand Srinivasan, Johannes Gehrke, Jennifer Widom, Hari Balakrishnan, Ugur Çetintemel, Mitch Cherniack, Richard Tibbetts, and Stan Zdonik. 2008. Towards a streaming SQL standard. Proc. VLDB Endow. 1, 2 (Aug. 2008), 1379--1390. Google Scholar
Digital Library
- JBoss. 2016. Drools. Retrieved April 13, 2016 from http://www.drools.org.Google Scholar
- Jess. 2016. Jess, the Rule Engine for the Java Platform. (2016). Retrieved April 13rd, 2016 from http://www.jessrules.com/.Google Scholar
- J. O. Kephart and D. M. Chess. 2003. The vision of autonomic computing. Computer 36, 1 (Jan 2003), 41--50. Google Scholar
Digital Library
- Jürgen Krämer and Bernhard Seeger. 2009. Semantics and implementation of continuous sliding window queries over data streams. ACM Trans. Database Syst. 34, 1 (2009), 1--49. DOI:http://dx.doi.org/ 10.1145/1508857.1508861 Google Scholar
Digital Library
- Geetika T. Lakshmanan, Ying Li, and Rob Strom. 2008. Placement strategies for internet-scale data stream systems. IEEE Internet Comput. 12, 6 (Nov. 2008), 50--60. DOI:http://dx.doi.org/10.1109/MIC.2008.129 Google Scholar
Digital Library
- Guoli Li and Hans-Arno Jacobsen. 2005. Composite subscriptions in content-based publish/subscribe systems. In Proceedings of the ACM/IFIP/USENIX 2005 International Conference on Middleware (Middleware’05). Springer-Verlag, New York, NY, 249--269. Google Scholar
Digital Library
- Björn Lohrmann, Daniel Warneke, and Odej Kao. 2013. Nephele streaming: Stream processing under QoS constraints at scale. Cluster Comput. 17, 1 (July 2013), 61--78. DOI:http://dx.doi.org/ 10.1007/s10586-013-0281-8 Google Scholar
Digital Library
- Michael Löwe. 1993. Algebraic approach to single-pushout graph transformation. Theor. Comput. Sci. 109, 12 (1993), 181--224. DOI:http://dx.doi.org/10.1016/0304-3975(93)90068-5 Google Scholar
Digital Library
- David Luckham. 2002. The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems (1st ed.). Addison-Wesley Professional. Google Scholar
Digital Library
- David Luckham and Roy Schulte. 2011. Event Processing Glossary—Version 2.0. Technical Report July. Event Processing Technical Society. 1--19 pages. Retrieved from http://www.complexevents.com/ 2011/08/23/event-processing-glossary-version-2/.Google Scholar
- Samuel Madden, Mehul Shah, Joseph M. Hellerstein, and Vijayshankar Raman. 2002. Continuously adaptive continuous queries over streams. In Proceedings of the 2002 ACM SIGMOD International Conference on Management of Data (SIGMOD’02). Vol. 13. ACM, New York, NY, 49. DOI:http://dx.doi.org/10.1145/564691.564698 Google Scholar
Digital Library
- Oracle. 2015. Oracle Stream Explorer. Retrieved October 31, 2015 from http://www.oracle.com/technetwork/middleware/complex-event-processing/overview/index.html.Google Scholar
- Peter Pietzuch, Jonathan Ledlie, Jeffrey Shneidman, Mema Roussopoulos, Matt Welsh, and Margo Seltzer. 2006. Network-aware operator placement for stream-processing systems. In Proceedings of the 22nd International Conference on Data Engineering (ICDE’06). IEEE, 49. Google Scholar
Digital Library
- Powersmiths. 2015. Powersmiths WOW - Build a more sustainable future. Retrieved October 28, 2015 from http://www.powersmithswow.com/.Google Scholar
- Zhengping Qian, Yong He, Chunzhi Su, Zhuojie Wu, Hongyu Zhu, Taizhi Zhang, Lidong Zhou, Yuan Yu, and Zheng Zhang. 2013. TimeStream: Reliable stream computation in the cloud. In Proceedings of the 8th ACM European Conference on Computer Systems. ACM Press, New York, NY, 1. DOI:http://dx.doi.org/10.1145/2465351.2465353 Google Scholar
Digital Library
- Ella Rabinovich, Opher Etzion, Sitvanit Ruah, and Sarit Archushin. 2010. Analyzing the behavior of event processing applications. In Proceedings of the 4th ACM International Conference on Distributed Event-Based Systems (DEBS’10). 223--234. DOI:http://dx.doi.org/10.1145/1827418.1827465 Google Scholar
Digital Library
- Ismael B. Rodriguez, Khalil Drira, Christophe Chassot, Karim Guennoun, and Mohamed Jmaiel. 2010. A rule-driven approach for architectural self adaptation in collaborative activities using graph grammars. Int. J. Auton. Comput. 1, 3 (2010), 226--245. Google Scholar
Digital Library
- Grzegorz Rozenberg (Ed.). 1997. Handbook of Graph Grammars and Computing by Graph Transformations, Volume 1: Foundations. World Scientific. Google Scholar
Digital Library
- Sergio Segura, David Benavides, Antonio Ruiz-Cortés, and Pablo Trinidad. 2008. Automated merging of feature models using graph transformations. In Generative and Transformational Techniques in Software Engineering II, Ralf Lämmel, Joost Visser, and João Saraiva (Eds.). Lecture Notes in Computer Science, Vol. 5235. Springer, Berlin, 489--505. Google Scholar
Digital Library
- Guy Sharon and Opher Etzion. 2008. Event-processing network model and implementation. IBM Syst. J. 47, 2 (2008), 321--334. DOI:http://dx.doi.org/10.1147/sj.472.0321 Google Scholar
Digital Library
- Software AG. 2015. APAMA Streaming Analytics. Retrieved October 31, 2015 from http://www.softwareag.com/corporate/products/apama_webmethods/analytics/overview/.Google Scholar
- Storm. 2015. Storm: distributed and fault-tolerant realtime computation. Retrieved October 1, 2015 from http://storm-project.net/.Google Scholar
- Gabriele Taentzer. 2004. AGG: A graph transformation environment for modeling and validation of software. In Applications of Graph Transformations with Industrial Relevance, John L. Pfaltz, Manfred Nagl, and Boris Bhlen (Eds.). Lecture Notes in Computer Science, Vol. 3062. Springer, Berlin, 446--453.Google Scholar
- Matthias Weidlich, Jan Mendling, and Avigdor Gal. 2013. Net-based analysis of event processing networks the fast flower delivery case. In Application and Theory of Petri Nets and Concurrency SE-15, José-Manuel Colom and Jörg Desel (Eds.). Lecture Notes in Computer Science, Vol. 7927. Springer, Berlin, 270--290. DOI:http://dx.doi.org/10.1007/978-3-642-38697-8_15 Google Scholar
Digital Library
- Eugene Wu, Yanlei Diao, and Shariq Rizvi. 2006. High-performance complex event processing over streams. In Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data—SIGMOD’06, Vol. 10. ACM Press, New York, NY, 407. DOI:http://dx.doi.org/10.1145/1142473.1142520 Google Scholar
Digital Library
- Ying Xing, Stan Zdonik, and Jeong-hyon Hwang. 2005. Dynamic load distribution in the Borealis stream processor. In Proceedings of the 21st International Conference on Data Engineering (ICDE’05). IEEE, 791--802. DOI:http://dx.doi.org/10.1109/ICDE.2005.53 Google Scholar
Digital Library
Index Terms
Attributed Graph Rewriting for Complex Event Processing Self-Management
Recommendations
Achieving self-managed deployment in a distributed environment
This paper proposes algorithms and mechanisms for achieving self-optimized deployment of computationally intensive scientific and engineering applications in highly dynamic and large-scale distributed environment. The primary focus is on the modeling of ...
A Design Methodology for Self-Management in Distributed Environments
CSE '09: Proceedings of the 2009 International Conference on Computational Science and Engineering - Volume 01Autonomic computing is a paradigm that aims at reducing administrative overhead by providing autonomic managers to make applications self-managing. In order to better deal with dynamic environments, for improved performance and scalability, we advocate ...
Autonomic computing system for self-management of machine-to-machine networks
Self-IoT '12: Proceedings of the 2012 international workshop on Self-aware internet of thingsThe internet of things consists of a high amount of heterogeneous objects that are widely distributed and evolve frequently according to their context changes. Management of such a complex environment is costly in terms of time and money. Machine to ...






Comments