skip to main content
research-article

A control theoretical approach to self-optimizing block transfer in Web service grids

Published:22 May 2008Publication History
Skip Abstract Section

Abstract

Nowadays, Web Services (WS) play an important role in the dissemination and distributed processing of large amounts of data that become available on the Web. In many cases, it is essential to retrieve and process such data in blocks, in order to benefit from pipelined parallelism and reduced communication costs. This article deals with the problem of minimizing at runtime, in a self-managing way, the total response time of a call to a database exposed to a volatile environment, like the Grid, as a WS. Typically, in this scenario, response time exhibits a concave, nonlinear behavior depending on the client-controlled size of the individual requests comprising a fixed size task. In addition, no accurate profiling or internal state information is available, and the optimum point is volatile. This situation is encountered in several systems, such as WS Management Systems (WSMS) for DBMS-like data management over wide area service-based networks, and the widely spread OGSA-DAI WS for accessing and integrating traditional DBMS. The main challenges in this problem apart from the unavailability of a model, include the presence of noise, which incurs local minima, the volatility of the environment, which results in moving optimum operating point, and the requirements for fast convergence to the optimal size of the request from the side of the client rather than of the server, and for low overshooting. Two solutions are presented in this work, which fall into the broader areas of runtime optimization and switching extremum control. They incorporate heuristics to avoid local optimal points, and address all the aforementioned challenges. The effectiveness of the solutions is verified via both empirical evaluation in real cases and simulations, which show that significant performance benefits can be provided rendering obsolete the need for detailed profiling of the WS.

References

  1. Abdelzaher, T. F., Shin, K. G., and Bhatti, N. T. 2002. Performance guarantees for Web server end-systems: A control-theoretical approach. IEEE Trans. Parallel Distrib. Systems 13, 1, 80--96. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Abdelzaher, T. F., Stankovic, A., Lu, C., Zhang, R., and Lu, Y. 2003. Feedback performance control in software services. IEEE Cont. Sys. Mag. 23, 3.Google ScholarGoogle Scholar
  3. Alpdemir, M. N., Mukherjee, A., Paton, N. W., Watson, P., Fernandes, A. A. A., Gounaris, A., and Smith, J. 2003. Service-based distributed querying on the grid. In Proceedings of the 1st International Conference on Service Oriented Computing (ICSOC). Springer, 467--482.Google ScholarGoogle Scholar
  4. Alpdemir, N., Gounaris, A., Mukherjee, A., Fitzgerald, D., Paton, N. W., Watson, P., Sakellariou, R., Fernandes, A. A., and Smith, J. 2005. Experience on performance evaluation with OGSA-DQP. In Proceedings of the UK e-Science All Hands Meeting.Google ScholarGoogle Scholar
  5. Antonioletti, M., Atkinson, M. P., Baxter, R., Borely, A., Chue Hong, N. P., Collins, B., Hardman, N., Hune, A., Knox, A., Jackson, M., Krause, A., Laws, S., Magowan, J., Paton, N. W., Pearson, D., Sugden, T., Watson, P., and Westhead, M. 2005. The design and implementation of grid database services in OGSA-DAI. Concurrency—Practice and Experience 17, 2-4, 357--376. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Ariyur, K. and Krstic, M. 2003. Real-Time Optimization by Extremum-Seeking Control. John Wiley & Sons. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Blackman, P. 1962. Extremum-Seeking Regulators: An Exposition of Adaptive Control. Pergamon Press.Google ScholarGoogle Scholar
  8. Choi, J., Krstic, M., Ariyur, K., and Lee, J. 2002. Extremum seeking control for discrete-time systems. IEEE Trans. Auto. Cont. 47, 2, 318--323.Google ScholarGoogle ScholarCross RefCross Ref
  9. Diao, Y., Eskesen, F., Forehlich, S., Hellerstein, J., Spainhower, L., and Surendra, M. 2003. Generic online optimization of multiple configuration parameters with application to a database server. DSOM, 3--15. LNCS 2867.Google ScholarGoogle Scholar
  10. Diao, Y., Hellerstein, J. L., Parekh, S. S., Griffith, R., Kaiser, G. E., and Phung, D. B. 2005. Self-managing systems: A control theory foundation. In Proceedings of IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ECBS 2005). 441--448. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Dobrzelecki, B., Antonioletti, M., Schopf, J., Hume, A., Atkinson, M., Hong, N. C., Jackson, M., Karasavvas, K., Krause, A., Parsons, M., Sugden, T., and Theocharopoulos, E. 2006. Profiling OGSA-DAI Performance for Common Use Patterns. In Proceedings of the UK e-Science All Hands Meeting.Google ScholarGoogle Scholar
  12. Draper, C. and Li, Y. T. 1954. Principles of Optimizing Control Systems. ASME Publications.Google ScholarGoogle Scholar
  13. Flardh, O., Johansson, K. J., and Johansson, M. 2005. A new feedback control mechanism for error correction in packet-switched networks. In Proceedings of the 44th IEEE Conference on Decision and Control (CDC-ECC'05), 488--493.Google ScholarGoogle Scholar
  14. Gandhi, N., Hellerstein, J., Tilbury, D., and Jayram, T. 2002. Using control theory to achieve service level objectives in performance management. Real-Time Sys. 23, 127--141. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Gounaris, A., Sakellariou, R., Paton, N. W., and Fernandes, A. A. A. 2006. A novel approach to resource scheduling for parallel query processing on computational grids. Distrib. Para. Databases 19, 2-3, 87--106. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Gounaris, A., Smith, J., Paton, N. W., Sakellariou, R., Fernandes, A. A. A., and Watson, P. 2005. Adapting to changing resource performance in grid query processing. In Data Management in Grids, First VLDB Workshop (DMG 2005). 30--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Gounaris, A., Yfoulis, C., Sakellariou, R., and Dikaiakos, M. D. 2007. Self-optimizing block transfer in Web service grids. In Proceedings of the 9th Annual ACM International Workshop on Web Information and Data management (WIDM'07). ACM, 49--56. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Hellerstein, J., Diao, Y., Parekh, S., and Tilbury, D. 2005. Control engineering for computing systems. IEEE Cont. Syst. Mag. 25, 6, 56--68.Google ScholarGoogle ScholarCross RefCross Ref
  19. Killingsworth, N. and Krstic, M. 2006. PID tuning using extremum seeking. IEEE Cont. Syst. Mag., (Feb.), 70--79.Google ScholarGoogle Scholar
  20. Kosar, T. and Livny, M. 2004. Stork: Making data placement a first class citizen in the grid. In 24th International Conference on Distributed Computing Systems (ICDCS 2004), 24-26 (Mar.), Hachioji, Tokyo, Japan. IEEE Computer Society, 342--349. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Krstic, M. and Wang, H. 2000. Stability of extremum seeking feedback for general nonlinear dynamic systems. Automatica 36, 595--601. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Larsson, S. 2001. Literature study on extremum control. Tech. rep., Chalmers University of Technology.Google ScholarGoogle Scholar
  23. Liu, D. T., Franklin, M. J., and Parekh, D. 2003a. Griddb: A database interface to the grid. In Proceedings of the 2003 ACM SIGMOD International Conference of the Management of Data, A. Y. Halevy, Z. G. Ives, and A. Doan, Eds. ACM, 660. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Liu, X., Sha, L., Diao, Y., Froehlich, S., Hellerstein, J. L., and Parekh, S. S. 2003b. Online response time optimization of Apache Web server. In Proceedings of the 11th International Workshop on Quality of Service (IWQoS). 461--478. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Lu, C., Wang, X., and Koutsoukos, X. D. 2005. Feedback utilization control in distributed real-time systems with end-to-end tasks. IEEE Trans. Para. Distrib. Sys. 16, 6, 550--561. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Narayanan, S., Catalyrek, U. V., Kurc, T. M., Zhang, X., and Saltz, J. H. 2003. Applying database support for large scale data driven science in distributed environemnts. In Proceedings of the 4th Workshop on Grid Computing (GRID'03). Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Persinni, A. 1988. The Mathematics of Nonlinear Programming. Springer-Verlag. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Raghavachari, Y., Reimer, D., and Johnson, R. 2003. The deployer's problem: Configuring application servers for performance and reliability. In Proceedings of the 25th International Conference on Software Engineering (ISCE2003). 484--489. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Seshasayee, B., Schwan, K., and Widener, P. 2004. Soap-binQ: High-performance soap with continuous quality management. In Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS). 158--165. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Srivastava, U., Munagala, K., Widom, J., and Motwani, R. 2006. Query optimization over Web services. In Proceedings of the 32nd International Conference on Very Large Databases (VLDB). 355--366. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Stanojevic, R., Kellet, C., and Shorten, R. N. 2006. Adaptive tuning of drop-tail buffers for reducing queueing delays. IEEE Comm. Letters 10, 7.Google ScholarGoogle ScholarCross RefCross Ref
  32. Stanojevic, R. and Shorten, R. 2007. How expensive is link utilization. Tech. Rep., available at http://www.hamilton.ie./person/rade/QP.pdf.Google ScholarGoogle Scholar
  33. Wellstead, P. and Zarrop, M. B. 1995. Self tuning systems: control and signal processing. John Wiley & Sons. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A control theoretical approach to self-optimizing block transfer in Web service grids

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!