Abstract
Nowadays, Web Services (WS) play an important role in the dissemination and distributed processing of large amounts of data that become available on the Web. In many cases, it is essential to retrieve and process such data in blocks, in order to benefit from pipelined parallelism and reduced communication costs. This article deals with the problem of minimizing at runtime, in a self-managing way, the total response time of a call to a database exposed to a volatile environment, like the Grid, as a WS. Typically, in this scenario, response time exhibits a concave, nonlinear behavior depending on the client-controlled size of the individual requests comprising a fixed size task. In addition, no accurate profiling or internal state information is available, and the optimum point is volatile. This situation is encountered in several systems, such as WS Management Systems (WSMS) for DBMS-like data management over wide area service-based networks, and the widely spread OGSA-DAI WS for accessing and integrating traditional DBMS. The main challenges in this problem apart from the unavailability of a model, include the presence of noise, which incurs local minima, the volatility of the environment, which results in moving optimum operating point, and the requirements for fast convergence to the optimal size of the request from the side of the client rather than of the server, and for low overshooting. Two solutions are presented in this work, which fall into the broader areas of runtime optimization and switching extremum control. They incorporate heuristics to avoid local optimal points, and address all the aforementioned challenges. The effectiveness of the solutions is verified via both empirical evaluation in real cases and simulations, which show that significant performance benefits can be provided rendering obsolete the need for detailed profiling of the WS.
- Abdelzaher, T. F., Shin, K. G., and Bhatti, N. T. 2002. Performance guarantees for Web server end-systems: A control-theoretical approach. IEEE Trans. Parallel Distrib. Systems 13, 1, 80--96. Google Scholar
Digital Library
- Abdelzaher, T. F., Stankovic, A., Lu, C., Zhang, R., and Lu, Y. 2003. Feedback performance control in software services. IEEE Cont. Sys. Mag. 23, 3.Google Scholar
- Alpdemir, M. N., Mukherjee, A., Paton, N. W., Watson, P., Fernandes, A. A. A., Gounaris, A., and Smith, J. 2003. Service-based distributed querying on the grid. In Proceedings of the 1st International Conference on Service Oriented Computing (ICSOC). Springer, 467--482.Google Scholar
- Alpdemir, N., Gounaris, A., Mukherjee, A., Fitzgerald, D., Paton, N. W., Watson, P., Sakellariou, R., Fernandes, A. A., and Smith, J. 2005. Experience on performance evaluation with OGSA-DQP. In Proceedings of the UK e-Science All Hands Meeting.Google Scholar
- Antonioletti, M., Atkinson, M. P., Baxter, R., Borely, A., Chue Hong, N. P., Collins, B., Hardman, N., Hune, A., Knox, A., Jackson, M., Krause, A., Laws, S., Magowan, J., Paton, N. W., Pearson, D., Sugden, T., Watson, P., and Westhead, M. 2005. The design and implementation of grid database services in OGSA-DAI. Concurrency—Practice and Experience 17, 2-4, 357--376. Google Scholar
Digital Library
- Ariyur, K. and Krstic, M. 2003. Real-Time Optimization by Extremum-Seeking Control. John Wiley & Sons. Google Scholar
Digital Library
- Blackman, P. 1962. Extremum-Seeking Regulators: An Exposition of Adaptive Control. Pergamon Press.Google Scholar
- Choi, J., Krstic, M., Ariyur, K., and Lee, J. 2002. Extremum seeking control for discrete-time systems. IEEE Trans. Auto. Cont. 47, 2, 318--323.Google Scholar
Cross Ref
- Diao, Y., Eskesen, F., Forehlich, S., Hellerstein, J., Spainhower, L., and Surendra, M. 2003. Generic online optimization of multiple configuration parameters with application to a database server. DSOM, 3--15. LNCS 2867.Google Scholar
- Diao, Y., Hellerstein, J. L., Parekh, S. S., Griffith, R., Kaiser, G. E., and Phung, D. B. 2005. Self-managing systems: A control theory foundation. In Proceedings of IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ECBS 2005). 441--448. Google Scholar
Digital Library
- Dobrzelecki, B., Antonioletti, M., Schopf, J., Hume, A., Atkinson, M., Hong, N. C., Jackson, M., Karasavvas, K., Krause, A., Parsons, M., Sugden, T., and Theocharopoulos, E. 2006. Profiling OGSA-DAI Performance for Common Use Patterns. In Proceedings of the UK e-Science All Hands Meeting.Google Scholar
- Draper, C. and Li, Y. T. 1954. Principles of Optimizing Control Systems. ASME Publications.Google Scholar
- Flardh, O., Johansson, K. J., and Johansson, M. 2005. A new feedback control mechanism for error correction in packet-switched networks. In Proceedings of the 44th IEEE Conference on Decision and Control (CDC-ECC'05), 488--493.Google Scholar
- Gandhi, N., Hellerstein, J., Tilbury, D., and Jayram, T. 2002. Using control theory to achieve service level objectives in performance management. Real-Time Sys. 23, 127--141. Google Scholar
Digital Library
- Gounaris, A., Sakellariou, R., Paton, N. W., and Fernandes, A. A. A. 2006. A novel approach to resource scheduling for parallel query processing on computational grids. Distrib. Para. Databases 19, 2-3, 87--106. Google Scholar
Digital Library
- Gounaris, A., Smith, J., Paton, N. W., Sakellariou, R., Fernandes, A. A. A., and Watson, P. 2005. Adapting to changing resource performance in grid query processing. In Data Management in Grids, First VLDB Workshop (DMG 2005). 30--44. Google Scholar
Digital Library
- Gounaris, A., Yfoulis, C., Sakellariou, R., and Dikaiakos, M. D. 2007. Self-optimizing block transfer in Web service grids. In Proceedings of the 9th Annual ACM International Workshop on Web Information and Data management (WIDM'07). ACM, 49--56. Google Scholar
Digital Library
- Hellerstein, J., Diao, Y., Parekh, S., and Tilbury, D. 2005. Control engineering for computing systems. IEEE Cont. Syst. Mag. 25, 6, 56--68.Google Scholar
Cross Ref
- Killingsworth, N. and Krstic, M. 2006. PID tuning using extremum seeking. IEEE Cont. Syst. Mag., (Feb.), 70--79.Google Scholar
- Kosar, T. and Livny, M. 2004. Stork: Making data placement a first class citizen in the grid. In 24th International Conference on Distributed Computing Systems (ICDCS 2004), 24-26 (Mar.), Hachioji, Tokyo, Japan. IEEE Computer Society, 342--349. Google Scholar
Digital Library
- Krstic, M. and Wang, H. 2000. Stability of extremum seeking feedback for general nonlinear dynamic systems. Automatica 36, 595--601. Google Scholar
Digital Library
- Larsson, S. 2001. Literature study on extremum control. Tech. rep., Chalmers University of Technology.Google Scholar
- Liu, D. T., Franklin, M. J., and Parekh, D. 2003a. Griddb: A database interface to the grid. In Proceedings of the 2003 ACM SIGMOD International Conference of the Management of Data, A. Y. Halevy, Z. G. Ives, and A. Doan, Eds. ACM, 660. Google Scholar
Digital Library
- Liu, X., Sha, L., Diao, Y., Froehlich, S., Hellerstein, J. L., and Parekh, S. S. 2003b. Online response time optimization of Apache Web server. In Proceedings of the 11th International Workshop on Quality of Service (IWQoS). 461--478. Google Scholar
Digital Library
- Lu, C., Wang, X., and Koutsoukos, X. D. 2005. Feedback utilization control in distributed real-time systems with end-to-end tasks. IEEE Trans. Para. Distrib. Sys. 16, 6, 550--561. Google Scholar
Digital Library
- Narayanan, S., Catalyrek, U. V., Kurc, T. M., Zhang, X., and Saltz, J. H. 2003. Applying database support for large scale data driven science in distributed environemnts. In Proceedings of the 4th Workshop on Grid Computing (GRID'03). Google Scholar
Digital Library
- Persinni, A. 1988. The Mathematics of Nonlinear Programming. Springer-Verlag. Google Scholar
Digital Library
- Raghavachari, Y., Reimer, D., and Johnson, R. 2003. The deployer's problem: Configuring application servers for performance and reliability. In Proceedings of the 25th International Conference on Software Engineering (ISCE2003). 484--489. Google Scholar
Digital Library
- Seshasayee, B., Schwan, K., and Widener, P. 2004. Soap-binQ: High-performance soap with continuous quality management. In Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS). 158--165. Google Scholar
Digital Library
- Srivastava, U., Munagala, K., Widom, J., and Motwani, R. 2006. Query optimization over Web services. In Proceedings of the 32nd International Conference on Very Large Databases (VLDB). 355--366. Google Scholar
Digital Library
- Stanojevic, R., Kellet, C., and Shorten, R. N. 2006. Adaptive tuning of drop-tail buffers for reducing queueing delays. IEEE Comm. Letters 10, 7.Google Scholar
Cross Ref
- Stanojevic, R. and Shorten, R. 2007. How expensive is link utilization. Tech. Rep., available at http://www.hamilton.ie./person/rade/QP.pdf.Google Scholar
- Wellstead, P. and Zarrop, M. B. 1995. Self tuning systems: control and signal processing. John Wiley & Sons. Google Scholar
Digital Library
Index Terms
A control theoretical approach to self-optimizing block transfer in Web service grids
Recommendations
Self-optimizing block transfer in web service grids
WIDM '07: Proceedings of the 9th annual ACM international workshop on Web information and data managementNowadays, Web Services (WSs) play an increasingly important role in Web data management solutions, since they offer a practical solution for accessing and manipulating data sources spanning administrative domains. Nevertheless, they are notoriously slow ...
Service migration in autonomic service oriented grids
AusGrid '08: Proceedings of the sixth Australasian workshop on Grid computing and e-research - Volume 82The introduction of Web services into grids helped to address their two main obstacles to be embraced by business and industry, heterogeneity and useability. However, many problems are still open, e.g., grid reconfiguration, reliability and computing ...
Grid service composition in BPEL for scientific applications
OTM'07: Proceedings of the 2007 OTM confederated international conference on On the move to meaningful internet systems: CoopIS, DOA, ODBASE, GADA, and IS - Volume Part IIGrid computing aims to create an accessible virtual supercomputer by integrating distributed computers to form a parallel infrastructure for processing applications. To enable service-oriented Grid computing, the Grid computing architecture was aligned ...






Comments