skip to main content
poster

Effective communication and computation overlap with hybrid MPI/SMPSs

Authors Info & Claims
Published:09 January 2010Publication History
Skip Abstract Section

Abstract

Communication overhead is one of the dominant factors affecting performance in high-performance computing systems. To reduce the negative impact of communication, programmers overlap communication and computation by using asynchronous communication primitives. This increases code complexity, requiring more development effort and making less readable programs. This paper presents the hybrid use of MPI and SMPSs (SMP superscalar, a task-based shared-memory programming model) that allows the programmer to easily introduce the asynchrony necessary to overlap communication and computation. We demonstrate the hybrid use of MPI/SMPSs with the high-performance LINPACK benchmark (HPL), and compare it to the pure MPI implementation, which uses the look-ahead technique to overlap communication and computation. The hybrid MPI/SMPSs version significantly improves the performance of the pure MPI version, getting close to the asymptotic performance at medium problem sizes and still getting significant benefits at small/large problem sizes.

References

  1. J.M. Perez, L. Martinell, R.M. Badia and J. Labarta. A dependency aware task-based programming environment for multi-core architecture. Proceedings of IEEE Cluster 2008, September 2008.Google ScholarGoogle ScholarCross RefCross Ref
  2. V. Marjanovic, J.M. Perez, E. Ayguadé, J. Labarta and M. Valero. Overlapping Communication and Computation by Using a Hybrid MPI/SMPSs Approach. UPC-DAC-RR-2009-35 Research Report, Technical University of Catalunya. May 2009.Google ScholarGoogle Scholar
  3. J. Dongarra, P. Luszczek and A. Petitet. The LINPACK Benchmark: Past, Present and Future. Concurrency and Computation: Practice and Experience. Vol. 15, issue 9, pp. 803--820. 2003.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Effective communication and computation overlap with hybrid MPI/SMPSs

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in

              Full Access

              • Published in

                cover image ACM SIGPLAN Notices
                ACM SIGPLAN Notices  Volume 45, Issue 5
                PPoPP '10
                May 2010
                346 pages
                ISSN:0362-1340
                EISSN:1558-1160
                DOI:10.1145/1837853
                Issue’s Table of Contents
                • cover image ACM Conferences
                  PPoPP '10: Proceedings of the 15th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming
                  January 2010
                  372 pages
                  ISBN:9781605588773
                  DOI:10.1145/1693453

                Copyright © 2010 Copyright held by author(s).

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 9 January 2010

                Check for updates

                Qualifiers

                • poster

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader
              About Cookies On This Site

              We use cookies to ensure that we give you the best experience on our website.

              Learn more

              Got it!