Article

CLARINET: WAN-aware optimization for analytics queries

Authors:

Raajay Viswanathan,

Ganesh Ananthanarayanan, and

Aditya AkellaAuthors Info & Claims

OSDI'16: Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation

November 2016

Pages 435 - 450

Published: 02 November 2016 Publication History

Abstract

Recent work has made the case for geo-distributed analytics, where data collected and stored at multiple datacenters and edge sites world-wide is analyzed in situ to drive operational and management decisions. A key issue in such systems is ensuring low response times for analytics queries issued against geo-distributed data. A central determinant of response time is the query execution plan (QEP). Current query optimizers do not consider the network when deriving QEPs, which is a key drawback as the geo-distributed sites are connected via WAN links with heterogeneous and modest bandwidths, unlike intra-datacenter networks. We propose CLARINET, a novel WAN-aware query optimizer. Deriving a WAN-aware QEP requires working jointly with the execution layer of analytics frameworks that places tasks to sites and performs scheduling. We design efficient heuristic solutions in CLARINET to make such a joint decision on the QEP. Our experiments with a real prototype deployed across EC2 datacenters, and large-scale simulations using production workloads show that CLARINET improves query response times by ≥ 50% compared to state-of-the-art WAN-aware task placement and scheduling.

References

[1]

Amazon datacenter locations. https://aws.amazon.com/about-aws/global-infrastructure/.

[2]

Apache Calcite - a dynamic data management framework. http://calcite.incubator.apache.org. Accessed 04-27-2015.

[3]

Apache Hive. http://hive.apache.org.

[4]

Apache Tez. http://tez.apache.org.

[5]

Google datacenter locations. http://www.google.com/about/datacenters/inside/locations/.

[6]

Microsoft datacenters. http://www.microsoft.com/en-us/server-cloud/cloud-os/global-datacenters.aspx.

[7]

Spark SQL. https://spark.apache.org/sql.

[8]

TPC Benchmark DS (TPC-DS). http://www.tpc.org/tpcds.

[9]

AGARWAL, S., KANDULA, S., BRUNO, N., WU, M.-C., STOICA, I., AND ZHOU, J. Reoptimizing data parallel computing. In NSDI (2012).

Digital Library

[10]

ARMBRUST, M., XIN, R. S., LIAN, C., HUAI, Y., LIU, D., BRADLEY, J. K., MENG, X., KAFTAN, T., FRANKLIN, M. J., GHODSI, A., AND ZAHARIA, M. Spark SQL: Relational data processing in Spark. In SIGMOD (2015).

Digital Library

[11]

AVNUR, R., AND HELLERSTEIN, J. M. Eddies: Continuously adaptive query processing. In Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data (New York, NY, USA, 2000), SIGMOD '00, ACM, pp. 261-272.

Digital Library

[12]

BERNSTEIN, P. A., AND CHIU, D.-M. W. Using semi-joins to solve relational queries. Journal of the ACM 28, 1 (1981), 25-40.

Digital Library

[13]

CALDER, M., FAN, X., HU, Z., KATZ-BASSETT, E., HEIDEMANN, J., AND GOVINDAN, R. Mapping the expansion of Google's serving infrastructure. In IMC (2013).

Digital Library

[14]

DEWITT, D. J., GHANDEHARIZADEH, S., SCHNEIDER, D., BRICKER, A., HSIAO, H.-I., RASMUSSEN, R., ET AL. The Gamma database machine project. IEEE Transactions on Knowledge and Data Engineering 2, 1 (1990), 44-62.

Digital Library

[15]

GANJAM, A., SIDDIQUI, F., ZHAN, J., LIU, X., STOICA, I., JIANG, J., SEKAR, V., AND ZHANG, H. C3: Internet-scale control plane for video quality optimization. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15) (Oakland, CA, May 2015), USENIX Association, pp. 131-144.

Digital Library

[16]

GRAEFE, G. Volcano: An extensible and parallel query evaluation system. IEEE Trans. on Knowl. and Data Eng. 6, 1 (Feb. 1994), 120-135.

Digital Library

[17]

GRAEFE, G. The cascades framework for query optimization. Data Engineering Bulletin 18 (1995).

[18]

GRANDL, R., ANANTHANARAYANAN, G., KANDULA, S., RAO, S., AND AKELLA, A. Multi-resource packing for cluster schedulers. In SIGCOMM (2014).

Digital Library

[19]

GUPTA, A., SUDARSHAN, S., AND VISHWANATHAN, S. Query scheduling in multi query optimization. In Database Engineering and Applications, 2001 International Symposium on. (2001), IEEE, pp. 11-19.

Digital Library

[20]

HONG, C.-Y., KANDULA, S., MAHAJAN, R., ZHANG, M., GILL, V., NANDURI, M., AND WATTENHOFER, R. Achieving high utilization with software-driven WAN. In SIGCOMM (2013).

Digital Library

[21]

HUNG, C.-C., GOLUBCHIK, L., AND YU, M. Scheduling jobs across geo-distributed datacenters. In SoCC (2015).

Digital Library

[22]

ISARD, M., PRABHAKARAN, V., CURREY, J., WIEDER, U., TALWAR, K., AND GOLDBERG, A. Quincy: Fair scheduling for distributed computing clusters. In SOSP (2009).

Digital Library

[23]

JAIN, S., KUMAR, A., MANDAL, S., ONG, J., POUTIEVSKI, L., SINGH, A., VENKATA, S., WANDERER, J., ZHOU, J., ZHU, M., ZOLLA, J., HÖLZLE, U., STUART, S., AND VAHDAT, A. B4: Experience with a globally-deployed software defined WAN. In SIGCOMM (2013).

Digital Library

[24]

JIANG, J., DAS, R., ANANTHANARAYANAN, G., CHOU, P., PADMANABHAN, V., SEKAR, V., DOMINIQUE, E., GOLISZEWSKI, M., KUKOLECA, D., VAFIN, R., AND ZHANG, H. Via: Improving internet telephony call quality using predictive relay selection. In SIGCOMM (2015).

Digital Library

[25]

KITSUREGAWA, M., TANAKA, H., AND MOTO-OKA, T. Application of hash to data base machine and its architecture. New Generation Computing 1, 1 (1983), 63-74.

[26]

KUMAR, A., JAIN, S., NAIK, U., RAGHURAMAN, A., KASINADHUNI, N., ZERMENO, E. C., GUNN, C. S., AI, J., CARLIN, B., AMARANDEI-STAVILA, M., ROBIN, M., SIGANPORIA, A., STUART, S., AND VAHDAT, A. BwE: Flexible, hierarchical bandwidth allocation for WAN distributed computing. In SIGCOMM (2015).

Digital Library

[27]

LI, H., GHODSI, A., ZAHARIA, M., SHENKER, S., AND STOICA, I. Tachyon: Reliable, memory speed storage for cluster computing frameworks. In Proceedings of the ACM Symposium on Cloud Computing (New York, NY, USA, 2014), SOCC '14, ACM, pp. 6:1-6:15.

Digital Library

[28]

MACKERT, L. F., AND LOHMAN, G. M. R* optimizer validation and performance evaluation for distributed queries. In PVLDB (1986).

Digital Library

[29]

MARKL, V., RAMAN, V., SIMMEN, D., LOHMAN, G., PIRAHESH, H., AND CILIMDZIC, M. Robust query processing through progressive optimization. In Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data (New York, NY, USA, 2004), SIGMOD '04, ACM, pp. 659-670.

Digital Library

[30]

MASTROLILLI, M., AND SVENSSON, O. (acyclic) job shops are hard to approximate. In FOCS (2008).

Digital Library

[31]

MONALDO, M., AND OLA, S. Improved bounds for flow shop scheduling. In ICALP (2009).

[32]

MULLIN, J. K. Optimal semijoins for distributed database systems. IEEE Transactions on Software Engineering 16, 5 (1990), 558-560.

Digital Library

[33]

OLSTON, C., REED, B., SRIVASTAVA, U., KUMAR, R., AND TOMKINS, A. Pig latin: A not-so-foreign language for data processing. In Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data (New York, NY, USA, 2008), SIGMOD '08, ACM, pp. 1099-1110.

Digital Library

[34]

POLYCHRONIOU, O., SEN, R., AND ROSS, K. A. Track join: distributed joins with minimal network traffic. In SIGMOD (2014).

Digital Library

[35]

PU, Q., ANANTHANARAYANAN, G., BODIK, P., KANDULA, S., AKELLA, A., BAHL, V., AND STOICA, I. Low latency geo-distributed data analytics. In SIGCOMM (2015).

Digital Library

[36]

RABKIN, A., ARYE, M., SEN, S., PAI, V. S., AND FREEDMAN, M. J. Aggregation and degradation in JetStream: Streaming analytics in the wide area. In NSDI (2014).

Digital Library

[37]

REN, X., ANANTHANARAYANAN, G., WIERMAN, A., AND YU, M. Hopper: Decentralized speculation-aware cluster scheduling at scale. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (New York, NY, USA, 2015), SIGCOMM '15, ACM, pp. 379-392.

Digital Library

[38]

RODIGER, W., MUHLBAUER, T., UNTERBRUNNER, P., REISER, A., KEMPER, A., AND NEUMANN, T. Locality-sensitive operators for parallel main-memory database clusters. In ICDE (2014).

[39]

ROY, P., SESHADRI, S., SUDARSHAN, S., AND BHOBE, S. Efficient and extensible algorithms for multi query optimization. In Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data (New York, NY, USA, 2000), SIGMOD '00, ACM, pp. 249-260.

Digital Library

[40]

SELLIS, T. K. Multiple-query optimization. ACM Trans. Database Syst. 13, 1 (Mar. 1988), 23-52.

Digital Library

[41]

URHAN, T., AND FRANKLIN, M. J. XJoin: A reactively-scheduled pipelined join operator. IEEE Data Engineering Bulletin (2000), 27-33.

[42]

VISWANATHAN, R., ANANTHANARAYANAN, G., AND AKELLA, A. Clarinet: Wan-aware optimization for analytics queries. Tech. Rep. TR1841, University of Wisconsin-Madison, 2016.

[43]

VULIMIRI, A., CURINO, C., GODFREY, B., PADHYE, J., AND VARGHESE, G. Global analytics in the face of bandwidth and regulatory constraints. In NSDI (2015).

Digital Library

[44]

WANG, X., OLSTON, C., SARMA, A. D., AND BURNS, R. Coscan: Cooperative scan sharing in the cloud. In Proceedings of the 2Nd ACM Symposium on Cloud Computing (2011), SOCC '11.

Digital Library

[45]

XIAO, X., HANNAN, A., BAILEY, B., AND NI, L. M. Traffic engineering with mpls in the internet. Network, IEEE 14, 2 (2000), 28-33.

Digital Library

[46]

XIN, R. S., ROSEN, J., ZAHARIA, M., FRANKLIN, M. J., SHENKER, S., AND STOICA, I. Shark: SQL and rich analytics at scale. In SIGMOD (2013).

Digital Library

[47]

XIONG, P., HACIGUMUS, H., AND NAUGHTON, J. F. A software-defined networking based approach for performance management of analytical queries on distributed data stores. In SIGMOD (2014).

Digital Library

[48]

ZAHARIA, M., CHOWDHURY, M., DAS, T., DAVE, A., MA, J., MCCAULEY, M., FRANKLIN, M., SHENKER, S., AND STOICA, I. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In NSDI (2012).

Digital Library

[49]

ZAMANIAN, E., BINNIG, C., AND SALAMA, A. Locality-aware partitioning in parallel database systems. In SIGMOD (2015).

Digital Library

Cited By

Wolfrath JChandra A(2023)PlexusProceedings of the 2023 ACM Symposium on Cloud Computing10.1145/3620678.3624643(1-16)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3620678.3624643
Shu JJin XMa YLiu XHuang GChiesa MChoffnes DMarkopoulou ABarcellos M(2021)Cost-effective data analytics across multiple cloud regionsProceedings of the SIGCOMM '21 Poster and Demo Sessions10.1145/3472716.3472842(1-3)Online publication date: 23-Aug-2021
https://dl.acm.org/doi/10.1145/3472716.3472842
Lai FYou JZhu XMadhyastha HChowdhury MBhagwan RPorter G(2020)SolProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388262(273-288)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388262
Show More Cited By

CLARINET: WAN-aware optimization for analytics queries
1. General and reference
  1. Cross-computing tools and techniques
2. Theory of computation
  1. Theory and algorithms for application domains
    1. Database theory
    2. Machine learning theory
      1. Reinforcement learning

Recommendations

Electrifying the Clarinet: A Guide to Modern Technology in Electroacoustic Clarinet Music through Three Electronic Etudes
Read More
Three interactive etudes for clarinet and computer
Read More
Approximating expressive queries on graph-modeled data

We present GeX for the approximate matching of complex queries on graph-modeled data.GeX generalizes existing approaches and allows for querying any graph-based datasets.GeX query language supports queries ranging from keyword-based to complex ones.GeX ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

OSDI'16: Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation

November 2016

786 pages

ISBN:9781931971331

Program Chairs:
Kimberly Keeton
Hewlett Packard Labs
,
Timothy Roscoe
ETH Zurich

Sponsors

VMware
NetApp
Google Inc.
Microsoft: Microsoft
Facebook: Facebook

In-Cooperation

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

USENIX Association

United States

Publication History

Published: 02 November 2016

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Wolfrath JChandra A(2023)PlexusProceedings of the 2023 ACM Symposium on Cloud Computing10.1145/3620678.3624643(1-16)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3620678.3624643
Shu JJin XMa YLiu XHuang GChiesa MChoffnes DMarkopoulou ABarcellos M(2021)Cost-effective data analytics across multiple cloud regionsProceedings of the SIGCOMM '21 Poster and Demo Sessions10.1145/3472716.3472842(1-3)Online publication date: 23-Aug-2021
https://dl.acm.org/doi/10.1145/3472716.3472842
Lai FYou JZhu XMadhyastha HChowdhury MBhagwan RPorter G(2020)SolProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388262(273-288)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388262
Yang YEo JKim GKim JLee SSeo JSong WChun BDan TDahlia M(2019)Apache nemoProceedings of the 2019 USENIX Conference on Usenix Annual Technical Conference10.5555/3358807.3358824(177-190)Online publication date: 10-Jul-2019
https://dl.acm.org/doi/10.5555/3358807.3358824
Abdi MMosayyebzadeh AHajkazemi MTurk AKrieger ODesnoyers PYadgar GNoh S(2019)Caching in the multiverseProceedings of the 11th USENIX Conference on Hot Topics in Storage and File Systems10.5555/3357062.3357087(19-19)Online publication date: 8-Jul-2019
https://dl.acm.org/doi/10.5555/3357062.3357087
Hong RChandra ADelimitrou CPorts D(2019)DLionProceedings of the 11th USENIX Conference on Hot Topics in Cloud Computing10.5555/3357034.3357048(11-11)Online publication date: 8-Jul-2019
https://dl.acm.org/doi/10.5555/3357034.3357048
Huang YShi YZhong ZFeng YCheng JLi JFan HLi CGuan TZhou J(2019)YugongProceedings of the VLDB Endowment10.14778/3352063.335213212:12(2155-2169)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.14778/3352063.3352132
Kumar DLi JChandra ASitaraman R(2019)A TTL-based Approach for Data Aggregation in Geo-distributed Streaming AnalyticsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/3341617.33261443:2(1-27)Online publication date: 19-Jun-2019
https://dl.acm.org/doi/10.1145/3341617.3326144
Shao WXu FChen LZheng HLiu F(2019)Stage Delay SchedulingProceedings of the 48th International Conference on Parallel Processing10.1145/3337821.3337872(1-11)Online publication date: 5-Aug-2019
https://dl.acm.org/doi/10.1145/3337821.3337872
Michailidou AGounaris ADesai BAnagnostopoulos DManolopoulos YNikolaidou M(2019)A fast solution for bi-objective traffic minimization in geo-distributed data flowsProceedings of the 23rd International Database Applications & Engineering Symposium10.1145/3331076.3331107(1-10)Online publication date: 10-Jun-2019
https://dl.acm.org/doi/10.1145/3331076.3331107
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents