research-article

Open access

Scalable Parallel Programming with CUDA: Is CUDA the parallel programming model that application developers have been waiting for?

Authors:

John Nickolls,

Ian Buck,

Michael Garland,

Kevin SkadronAuthors Info & Claims

Queue, Volume 6, Issue 2

Pages 40 - 53

https://doi.org/10.1145/1365490.1365500

Published: 01 March 2008 Publication History

All formats PDF

Abstract

The advent of multicore CPUs and manycore GPUs means that mainstream processor chips are now parallel systems. Furthermore, their parallelism continues to scale with Moore’s law. The challenge is to develop mainstream application software that transparently scales its parallelism to leverage the increasing number of processor cores, much as 3D graphics applications transparently scale their parallelism to manycore GPUs with widely varying numbers of cores.

References

[1]

NVIDIA. 2007. CUDA Technology; http://www.nvidia.com/CUDA.

Google Scholar

[2]

NVIDIA. 2007. CUDA Programming Guide 1.1; http://developer.download.nvidia.com/compute/cuda/1_1/NVIDIA_CUDA_Programming_Guide_1.1.pdf.

Google Scholar

[3]

Stratton, J.A., Stone, S. S., Hwu, W. W. 2008. M-CUDA: An efficient implementation of CUDA kernels on multicores. IMPACT Technical Report 08-01, University of Illinois at Urbana-Champaign, (February).

Google Scholar

[4]

See reference 3.

Google Scholar

[5]

Buck, I., Foley, T., Horn, D., Sugerman, J., Fatahalian, K., Houston, M., Hanrahan, P. Brook for GPUs: Stream computing on graphics hardware. 2004. Proceedings of SIGGRAPH (August): 777-786; http://doi.acm.org/10.1145/1186562.1015800.

Digital Library

Google Scholar

[6]

Stone, S.S., Yi, H., Hwu, W.W., Haldar, J.P., Sutton, B.P., Liang, Z.-P. 2007. How GPUs can improve the quality of magnetic resonance imaging. The First Workshop on General-Purpose Processing on Graphics Processing Units (October).

Google Scholar

[7]

Stone, J.E., Phillips, J.C., Freddolino, P.L., Hardy, D.J., Trabuco, L.G., Schulten, K. 2007. Accelerating molecular modeling applications with graphics processors. Journal of Computational Chemistry 28(16): 2618--2640; http://dx.doi.org/10.1002/jcc.20829.

Crossref

Google Scholar

[8]

Nyland, L., Harris, M., Prins, J. 2007. Fast n-body simulation with CUDA. In GPU Gems 3. H. Nguyen, ed. Addison-Wesley.

Google Scholar

[9]

Golub, G.H., and Van Loan, C.F. 1996. Matrix Computations, 3rd edition. Johns Hopkins University Press.

Digital Library

Google Scholar

[10]

Buatois, L., Caumon, G., Lévy, B. 2007. Concurrent number cruncher: An efficient sparse linear solver on the GPU. Proceedings of the High-Performance Computation Conference (HPCC), Springer LNCS.

Digital Library

Google Scholar

[11]

Sengupta, S., Harris, M., Zhang, Y., Owens, J.D. 2007. Scan primitives for GPU computing. In Proceedings of Graphics Hardware (August): 97--106.

Digital Library

Google Scholar

[12]

See Reference 3.

Google Scholar

Cited By

View all

Iskakov SYeh CPokhilko PYu YZhang LHarsha GAbraham VWen MWang MAdamski JChen TGull EZgid D(2025)Green/WeakCoupling: Implementation of fully self-consistent finite-temperature many-body perturbation theory for molecules and solidsComputer Physics Communications10.1016/j.cpc.2024.109380306(109380)Online publication date: Jan-2025
https://doi.org/10.1016/j.cpc.2024.109380
Smotherman HBernardinelli PPortillo SConnolly AKalmbach JStetzler SJurić MBektešević DLangford ZAdams FOldroyd WHolman MChandler CFuentes CGerdes DLin 林 HMarkwardt LMcNeill AMommert MNapier KPayne MRagozzine DRivkin ASchlichting HSheppard SStrauss RTrilling DTrujillo C(2024)The DECam Ecliptic Exploration Project (DEEP). VI. First Multiyear Observations of Trans-Neptunian ObjectsThe Astronomical Journal10.3847/1538-3881/ad1524167:3(136)Online publication date: 27-Feb-2024
https://doi.org/10.3847/1538-3881/ad1524
Chen LFeng CMa YZhao YWang C(2024)A review of rigid point cloud registration based on deep learningFrontiers in Neurorobotics10.3389/fnbot.2023.128133217Online publication date: 4-Jan-2024
https://doi.org/10.3389/fnbot.2023.1281332
Show More Cited By

Index Terms

Scalable Parallel Programming with CUDA: Is CUDA the parallel programming model that application developers have been waiting for?

Recommendations

CUDA Programming: A Developer's Guide to Parallel Computing with GPUs
NVIDIA cuda software and gpu parallel computing architecture
ISMM '07: Proceedings of the 6th international symposium on Memory management

In the past, graphics processors were special purpose hardwired application accelerators, suitable only for conventional rasterization-style graphics applications. Modern GPUs are now fully programmable, massively parallel floating point processors. ...
Multi-Core Programming with CUDA and OpenCL

Comments

Information & Contributors

Information

Published In

Queue Volume 6, Issue 2

GPU Computing

March/April 2008

63 pages

ISSN:1542-7730

EISSN:1542-7749

DOI:10.1145/1365490

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 March 2008

Published in QUEUE Volume 6, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,439
Total Citations
View Citations
86,599
Total Downloads

Downloads (Last 12 months)5,457
Downloads (Last 6 weeks)534

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Iskakov SYeh CPokhilko PYu YZhang LHarsha GAbraham VWen MWang MAdamski JChen TGull EZgid D(2025)Green/WeakCoupling: Implementation of fully self-consistent finite-temperature many-body perturbation theory for molecules and solidsComputer Physics Communications10.1016/j.cpc.2024.109380306(109380)Online publication date: Jan-2025
https://doi.org/10.1016/j.cpc.2024.109380
Smotherman HBernardinelli PPortillo SConnolly AKalmbach JStetzler SJurić MBektešević DLangford ZAdams FOldroyd WHolman MChandler CFuentes CGerdes DLin 林 HMarkwardt LMcNeill AMommert MNapier KPayne MRagozzine DRivkin ASchlichting HSheppard SStrauss RTrilling DTrujillo C(2024)The DECam Ecliptic Exploration Project (DEEP). VI. First Multiyear Observations of Trans-Neptunian ObjectsThe Astronomical Journal10.3847/1538-3881/ad1524167:3(136)Online publication date: 27-Feb-2024
https://doi.org/10.3847/1538-3881/ad1524
Chen LFeng CMa YZhao YWang C(2024)A review of rigid point cloud registration based on deep learningFrontiers in Neurorobotics10.3389/fnbot.2023.128133217Online publication date: 4-Jan-2024
https://doi.org/10.3389/fnbot.2023.1281332
Chakkour T(2024)Parallel computation to bidimensional heat equation using MPI/CUDA and FFTW packageFrontiers in Computer Science10.3389/fcomp.2023.13058005Online publication date: 11-Jan-2024
https://doi.org/10.3389/fcomp.2023.1305800
Paramonov PFrancken NRenders JIuso DElberfeld TDe Beenhouwer JSijbers J(2024)CAD-ASTRA: a versatile and efficient mesh projector for X-ray tomography with the ASTRA-toolboxOptics Express10.1364/OE.49819432:3(3425)Online publication date: 18-Jan-2024
https://doi.org/10.1364/OE.498194
Gao JJi WWang Y(2024)Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU SystemsACM Transactions on Architecture and Code Optimization10.1145/367684721:4(1-24)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3676847
Benthin CMeister DBarczak JMehalwal RTsakok JKensler A(2024)H-PLOC: Hierarchical Parallel Locally-Ordered Clustering for Bounding Volume Hierarchy ConstructionProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36753777:3(1-14)Online publication date: 9-Aug-2024
https://dl.acm.org/doi/10.1145/3675377
Laso RKrupitza DHunold S(2024)Exploring Scalability in C++ Parallel STL ImplementationsProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673065(284-293)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3673038.3673065
Pelton BSapek AEguro KLo DForin AHumphrey MXi JCox DKarandikar Rde Fine Licht JBabin ECaulfield ABurger D(2024)Wavefront Threading Enables Effective High-Level SynthesisProceedings of the ACM on Programming Languages10.1145/36564208:PLDI(1066-1090)Online publication date: 20-Jun-2024
https://doi.org/10.1145/3656420
Köpcke BGorlatch SSteuwer M(2024)Descend: A Safe GPU Systems Programming LanguageProceedings of the ACM on Programming Languages10.1145/36564118:PLDI(841-864)Online publication date: 20-Jun-2024
https://dl.acm.org/doi/10.1145/3656411
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

CUDA Programming: A Developer's Guide to Parallel Computing with GPUs

NVIDIA cuda software and gpu parallel computing architecture

Multi-Core Programming with CUDA and OpenCL

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Digital Edition

Magazine Site

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations