skip to main content
article

Adaptive selection of necessary and sufficient checkpoints for dynamic verification of temporal constraints in grid workflow systems

Authors Info & Claims
Published:01 June 2007Publication History
Skip Abstract Section

Abstract

In grid workflow systems, a checkpoint selection strategy is responsible for selecting checkpoints for conducting temporal verification at the runtime execution stage. Existing representative checkpoint selection strategies often select some unnecessary checkpoints and omit some necessary ones because they cannot adapt to the dynamics and uncertainty of runtime activity completion duration. In this article, based on the dynamics and uncertainty of runtime activity completion duration, we develop a novel checkpoint selection strategy that can adaptively select not only necessary, but also sufficient checkpoints. Specifically, we introduce a new concept of minimum time redundancy as a key reference parameter for checkpoint selection. An important feature of minimum time redundancy is that it can adapt to the dynamics and uncertainty of runtime activity completion duration. We develop a method on how to achieve minimum time redundancy dynamically along grid workflow execution and investigate its relationships with temporal consistency. Based on the method and the relationships, we present our strategy and rigorously prove its necessity and sufficiency. The simulation evaluation further demonstrates experimentally such necessity and sufficiency and its significant improvement on checkpoint selection over other representative strategies.

References

  1. Al-ali, R., Amin, K., Laszewski, G. V., Rana, O., Walker, D., Hategan, M., and Zaluzec, N. 2004. Analysis and provision of QoS for distributed grid applications. J. Grid Comput. 2, 2, 163--182.Google ScholarGoogle Scholar
  2. Abramson, D., Kommineni, J., McGregor, J. L., and Katzfey, J. 2004. An atmospheric sciences workflow and its implementation with Web services. In Proceedings of the 4th International Conference on Computational Science, Part I. Lecture Notes in Computer Science, vol. 3036, Springer Verlag, 164--173.Google ScholarGoogle Scholar
  3. Amin, K., Laszewski, G. V., Hategan, M., Zaluzec, N. J., Hampton, S., and Rossi, A. 2004. GridAnt: A client-controllable grid workflow. In Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04). 210--219. Google ScholarGoogle Scholar
  4. Buyya, R., Abramson, D., and Venugopal, S. 2005. The grid economy. Proceedings of the IEEE 93, 3, 698--714.Google ScholarGoogle Scholar
  5. Cao, J., Jarvis, S. A., Saini, S., and Nudd, G. R. 2003. GridFlow: Workflow management for grid computing. In Proceedings of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid'03). 198--205. Google ScholarGoogle Scholar
  6. Chen, J., Yang, Y., and Chen, T. Y. 2004. Dynamic verification of temporal constraints on-the-fly for workflow systems. In Proceedings of the 11th Asia-Pacific Software Engineering Conference (APSEC'04). IEEE Computer Society. 30--37. Google ScholarGoogle Scholar
  7. Chen, J. and Yang, Y. 2005a. An activity completion duration based checkpoint selection strategy for dynamic verification of fixed-time constraints in grid workflow systems. In Proceedings of the 2nd International Conference on Grid Service Engineering and Management (GSEM'05). Lecture Notes in Informatics P-69, 296--310.Google ScholarGoogle Scholar
  8. Chen, J. and Yang, Y. 2005b. Multiple temporal consistency states for dynamic verification of upper-bound constraints in grid workflow systems. In Proceedings of the 1st IEEE International Conference on e-Science and Grid Computing (e-Science'05). IEEE Computer Society, 124--131. Google ScholarGoogle Scholar
  9. Chen, J. and Yang, Y. 2005c. A minimum proportional time redundancy based checkpoint selection strategy for dynamic verification of fixed-time constraints in grid workflow systems. In Proceedings of the 12th Asia-Pacific Software Engineering Conference (APSEC'05). IEEE Computer Society, 299--306. Google ScholarGoogle Scholar
  10. Chen, J. and Yang, Y. 2006. Selecting necessary and sufficient checkpoints for dynamic verification of fixed-time constraints in grid workflow systems. In Proceedings of the 4th International Conference on Business Process Management (BPM'06). Lecture Notes in Computer Science, vol. 4102, Springer-Verlag, 445--450. Google ScholarGoogle Scholar
  11. Chinn, S. and Madey, G. 2000. Temporal representation and reasoning for workflow in engineering design change review. IEEE Trans. Engin. Manag. 47, 4, 485--492.Google ScholarGoogle Scholar
  12. Crown Team. 2006. CROWN portal, http://www.crown.org.cn/en/.Google ScholarGoogle Scholar
  13. Cybok, D. 2006. A grid workflow infrastructure. Concurr. Computat. Pract. Exper. Special Issue on Workflow in Grid Systems 18, 1243--1254. Google ScholarGoogle Scholar
  14. Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., and Vahi, K. 2003. Mapping abstract complex workflows onto grid environments. J. Grid Comput. 1, 1, 9--23.Google ScholarGoogle Scholar
  15. Eder, J., Panagos, E., and Rabinovich, M. 1999. Time constraints in workflow systems. In Proceedings of the 11th International Conference on Advanced Information Systems Engineering (CAiSE'99). Lecture Notes in Computer Science, vol. 1626, Springer Verlag, 286--300. Google ScholarGoogle Scholar
  16. Fahringer, T., Pllana, S., and Villazon, A. 2004. A-GWL: Abstract grid workflow language. In Proceedings of the 4th International Conference on Computational Science, Part III, Lecture Notes in Computer Science, vol. 3038, Springer Verlag, 42--49.Google ScholarGoogle Scholar
  17. Foster, I., Kesselman, C., Nick, J., and Tuecke, S. 2002. The physiology of the grid: An open grid services architecture for distributed systems integration. In Proceedings of the 5th Global Grid Forum Workshop (GGF5).Google ScholarGoogle Scholar
  18. Hagen, C. and Alonso, G. 2000. Exception handling in workflow management systems. IEEE Trans. Softw. Engin. 26, 10, 943--958. Google ScholarGoogle Scholar
  19. Han, Y., Sheth, A., and Bussler, C. 1998. A taxonomy of adaptive workflow management. In Proceedings of (Workshop on Towards Adaptive Workflow Systems) the ACM Conference on Computer Supported Cooperative Work.Google ScholarGoogle Scholar
  20. Huang, Y. 2003. JISGA: A jini-based service-oriented grid architecture. Inter. J. High Perform. Comput. Applic. 17, 3, 317--327. Google ScholarGoogle Scholar
  21. Klingemann, J., Wäsch, J., and Aberer, K. 1999a. Deriving service models in cross-organizational workflows. In Proceedings of the 9th International Workshop on Research Issues on Data Engineering Information Technology for Virtual Enterprises (RIDE-VE'99). 100--107. Google ScholarGoogle Scholar
  22. Klingemann, J., Wäsch, J., and Aberer, K. 1999b. Adaptive outsourcing in cross-organizational workflows. In Proceedings of the 11th Conference on Advanced Information Systems Engineering (Caise'99). Lecture Notes in Computer Science, vol. 1626, 417--421. Google ScholarGoogle Scholar
  23. Krishnan, S., Wagstrom, P., and Laszewski, G. V. 2002. GSFL: A workflow framework for grid services. Tech. rep., Argonne National Laboratory, Argonne, Chicago, IL, http://www-unix.globus.org/cog/papers/gsfl-paper.pdf.Google ScholarGoogle Scholar
  24. Li, H., Yang, Y., and Chen, T. Y. 2004. Resource constraints analysis of workflow specifications. J. Syst. Softw. 73, 2, 271--285. Google ScholarGoogle Scholar
  25. Li, J., Fan, Y., and Zhou, M. 2003. Timing constraint workflow nets for workflow analysis. IEEE Trans. Syst., Man Cybernet. Part A: Syst. Humans 33, 2, 179--193.Google ScholarGoogle Scholar
  26. Liu, Z. 1998. Performance analysis of stochastic timed Petri nets using linear programming approach. IEEE Trans. Softw. Engine. 11, 1014--1030. Google ScholarGoogle Scholar
  27. Marinescu, D. 2002. A grid workflow management architecture. Global Grid Forum White Paper, http://www.gridforum.org/mail_archive/gce-wg/2002/Archive/pdf00003.pdf.Google ScholarGoogle Scholar
  28. Marjanovic, O., and Orlowska, M. E. 1999. On modeling and verification of temporal constraints in production workflows. Know. Inform. Syst. 1, 2, 157--192.Google ScholarGoogle Scholar
  29. Reichert, M., Bauer, T., and Dadam, P. 1999. Enterprise-wide and cross-enterprise workflow management: Challenges and research issues for adaptive workflows. In Proceedings of Workshop on Enterprise-Wide and Cross-Enterprise Workflow Management. 56--64.Google ScholarGoogle Scholar
  30. Rinderle, S., Reichert, M., and Dadam, P. 2004. Flexible support of team processes by adaptive workflow systems. Distrib. Parall. Datab. 16, 1, 91--116. Google ScholarGoogle Scholar
  31. Sadiq, W. and Orlowska, M. E. 2000. Analysing process models using graph reduction techniques. Inform. Syst. 25, 2, 117--134. Google ScholarGoogle Scholar
  32. Simpson, D. R., Kelly, N., Jithesh, P. V., Donachy, P., Harmer, T. J., Perrott, R. H., Johnston, J., Kerr, P., McCurley, M., and McKee, S. 2004. GeneGrid: A practical workflow implementation for a grid based virtual bioinformatics laboratory. In Proceedings of the UK e-Science All Hands Meeting. 547--554.Google ScholarGoogle Scholar
  33. Son, J. H. and Kim, M. H. 2001. Improving the performance of time-constrained workflow processing. J. Syst. Softw. 58, 3, 211--219. Google ScholarGoogle Scholar
  34. Swin De W-G Team. 2007. System architecture of SwinDeW-G. http://www.ict.swin.edu.au/personal/jchen/SwinDeW-G/System_Architecture.pdf.Google ScholarGoogle Scholar
  35. van der Aalst, W. M. P. 1998. The application of petri nets to workflow management. J. Circ. Syst. Comput. 8, 1, 21--66.Google ScholarGoogle Scholar
  36. van der Aalst, W. M. P. 2000. Workflow verification: Finding control-flow errors using petri-net based techniques. In Proceedings of Business Process Management: Models, Techniques, and Empirical Studies. Lecture Notes in Computer Science, vol. 1806, Springer-Verlag, 161--183. Google ScholarGoogle Scholar
  37. Yan, J., Yang, Y., and Raikundalia, G. K. 2006. SwinDeW---A peer-to-peer based decentralised workflow management system. IEEE Trans. Syst. Man Cybern. Part A: Syst. Humans 36, 5, 922--935. Google ScholarGoogle Scholar
  38. Yu, J. and Buyya, R. 2005. A taxonomy of scientific workflow systems for grid computing. SIGMOD Record 34, 3, 44--49. Google ScholarGoogle Scholar
  39. Yu, J., Buyya, R. and Tham, C. K. 2005. QoS-based scheduling of workflow applications on service grids. In Proceedings of 1st IEEE International Conference on e-Science and Grid Computing (e-Science'05), IEEE Computer Society, 140--147. Google ScholarGoogle Scholar
  40. Zhuge, H., Cheung, T., and Pung, H. 2001. A timed workflow process model. J. Syst. Softw. 55, 3, 231--243. Google ScholarGoogle Scholar

Index Terms

  1. Adaptive selection of necessary and sufficient checkpoints for dynamic verification of temporal constraints in grid workflow systems

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!