XSEDE value added, cost avoidance, and return on investment

ABSTRACT

It is difficult for large research facilities to quantify a return on the investments that fund their operations. This is because there can be a time lag of years or decades between an innovation or discovery and the realization of its value through practical application. This report presents a three-part methodology that attempts to assess the value of federal investment in XSEDE: 1) a qualitative examination of the areas where XSEDE adds value to the activities of the open research community, 2) a "thought model" examining the cost avoidance realized by the National Science Foundation (NSF) through the centralization and coordination XSEDE provides, and 3) an assessment of the value XSEDE provides to Service Providers in the XD ecosystem. XSEDE adds significantly to the US research community because it functions as a unified interface to the XD ecosystem and because of its scale. A partly quantitative, partly qualitative analysis suggests the Return on Investment of NSF spending on XSEDE is greater than 1.0. -- indicating that the aggregate value received by the nation from XSEDE is greater than the cost of direct federal investment in XSEDE.

References

1. National Science Foundation. 2006. Cyberinfrastructure: From Supercomputing to the TeraGrid. http://www.nsf.gov/news/special_reports/cyber/fromsctotg.jsp
2. Stewart, C. A., R. D. Knepper, M. R. Link, M. A. Pierce, E. A. Wernert, N. Wilkins-Diehr. 2014. Cyberinfrastructure, Science Gateways, Campus Bridging, and Cloud Computing. In: Encyclopedia of Information Science and Technology. Hershey, PA. http://hdl.handle.net/2022/18608
3. Stewart, C. A., S. Simms, B. Plale, M. R. Link, D. Hancock and G. C. Fox. What is Cyberinfrastructure? In: Proceedings of SIGUCCS 2010. Norfolk, VA, 24--27 Oct 2010. http://dx.doi.org/10.1145/1878335.1878347
4. Catlett, C., W. E. Allcock, P. Andrews, R. Aydt, R. Bair, N. Balac, B. Banister, T. Barker, M. Bartelt, P. Beckman, F. Berman, G. Bertoline, A. Blatecky, J. Boisseau, J. Bottum, S. Brunett, J. Bunn, M. Butler, D. Carver, J. Cobb, T. Cockerill, P. F. Couvares, M. Dahan, D. Diehl, T. Dunning, I. Foster, K. Gaither, D. Gannon, S. Goasguen, M. Grobe, D. Hart, M. Heinzel, C. Hempel, W. Huntoon, J. Insley, C. Jordan, I. Judson, A. Kamrath, N. Karonis, C. Kesselman, P. Kovatch, L. Lane, S. L. Lathrop, D. Lifka, L. Liming, M. Livny, R. Loft, D. Marcusiu, J. Marsteller, S. Martin, D. S. McCaulay, J. McGee, L. McGinnis, M. A. McRobbie, P. Messina, R. Moore, J. P. Navarro, J. Nichols, M. E. Papka, R. Pennington, G. Pike, J. Pool, R. Reddy, D. Reed, T. Rimovsky, E. Roberts, R. Roskies, S. Sanielevici, J. R. Scott, A. Shankar, M. Sheddon, M. Showerman, D. Simmel, A. Singer, D. Skow, S. Smallen, W. Smith, C. Song, R. Stevens, C. A. Stewart, R. B. Stock, N. Stone, J. Towns, T. Urban, M. Vildibill, E. Walker, V. Welch, N. Wilkins-Diehr, R. Williams, L. Winkler, L. Zhao and A. Zimmerman. 2008. TeraGrid: Analysis of Organization, System Architecture, and Middleware Enabling New Types of Applications. L. Grandinetti, ed. Advances in Parallel Computing. Amsterdam, The Netherlands. http://hdl.handle.net/2022/14524
5. National Science Foundation. 2008. TeraGrid Phase III: eXtreme Digital Resources for Science and Engineering (XD) Program Solicitation NSF 08-571. http://www.nsf.gov/pubs/2008/nsf08571/nsf08571.htm
6. National Science Foundation. 2014. XSEDE: eXtreme Science and Engineering Discovery Environment (Award Abstract). http://www.nsf.gov/awardsearch/showAward?AWD_ID=1053575
7. National Science Foundation. 2014. Evaluating and Enhancing the eXtreme Digital (XD) Cyberinfrastructure for Maximum Usability and Science Impact (Award Abstract). http://www.nsf.gov/awardsearch/showAward?AWD_ID=0946505
8. Towns, J., T. Cockerill, M. Dahan, I. Foster, K. Gaither, A. Grimshaw, V. Hazlewood, S. Lathrop, D. Lifka, G. D. Peterson, R. Roskies, J. R. Scott and N. Wilkins-Diehr. 2014. XSEDE: Accelerating Scientific Discovery. In: Computing in Science & Engineering 16(5): 62--74. doi:10.1109/MCSE.2014.80
9. Furlani, T., M. Green, G. von Laszewski, V. Chaudhary and M. Jones. 2010. Technology Audit and Insertion Service for TeraGrid (Award Abstract). http://www.nsf.gov/awardsearch/showaward?awd_id=1025159
10. XSEDE. Service Provider Forum: Charter, Membership, and Governance, V12, 20 July 2014. http://hdl.handle.net/2142/49980
11. XSEDE. Requesting Membership in the XSEDE Federation, V2, 10 July 2014. http://hdl.handle.net/2142/49981
12. National Science Foundation. 2014. High Performance Computing System Acquisition: Continuing the Building of a More Inclusive Computing Environment for Science and Engineering Program Solicitation NSF 14-536. http://www.nsf.gov/pubs/2014/nsf14536/nsf14536.htm
13. National Science Foundation. 2014. Major Research Instrumentation Program: (MRI) Instrument Acquistion or Development Program Solicitation NSF 15-504. http://www.nsf.gov/pubs/2015/nsf15504/nsf15504.htm
14. Jones, A. Keynote Presentation. TeraGrid '07 (Madison, WI, 4 June 2007. http://www.union.wisc.edu/teragrid07/
15. National Science Foundation. 2015. High Performnace Computing System Acquisition: Enhancing the Petascale Computing Environment for Science and Engineering Program Solicitation 11-511. http://www.nsf.gov/pubs/2011/nsf11511/nsf11511.htm
16. National Science Foundation. 2014. Directorate for Computer and Information Science and Engineering (CISE): CISE Funding. http://www.nsf.gov/about/budget/fy2014/pdf/18_fy2014.pdf
17. Kinney, M. F. and C. A. Raiborn. 2011. Cost Accounting. South-Western, Mason, OH, 2011. ISBN: 978-1-111-97172.
18. Newby, G., A. Apon, N. Berente, R. Eigenmann, S. Fratkin, D. Lifka and C. A. Stewart. 2014. Return on Investment from Academic Supercomputing: Panel presented at: SC14 (Supercomputing 2014), New Orleans, LA, November 21, 2014. http://hdl.handle.net/2022/19242
19. Apon, A., S. Ahalt, V. Dantuluri, C. Gurdgiev, M. Limayem, L. Ngo and M. Stealey. 2010. High Performance Computing Instrumentation and Research Productivity in U.S. Universities. Journal of Information Technology Impact, 10(2), 87--98. http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1679248
20. Apon, A. W., L. B. Ngo, M. E. Payne and P. W. Wilson. 2014. Assessing the effect of high performance computing capabilities on academic research output. Empirical Economics 48: 283--312. DOI: 10.1007/s00181-014-0833-7
21. Joseph, E. C., C. Dekate and S. Conway. Real-World Examples of Supercomputers Used For Economic and Societal Benefits: A Prelude to What the Exascale Era Can Provide (Special Study). International Data Corporation (IDC). 2014. http://casc.org/wp-content/uploads/2014/07/IDCReportRealWorldExamplesOfBenefitsOfSupercomputers.pdf
22. Tabor Griffin Communications. High-Performance Computing Contributions to Society. Tabor Griffin Communications, 1998. http://www.tgc.com/hpcbook/toc1.html
23. PRACE. PRACE (Partnership for Advanced Computing in Europe). Home page. http://www.prace-ri.eu
24. Compute Canada. Compute Canada. Home Page. https://www.computecanada.ca
25. XSEDE. Extended Collaborative Support (ECSS). http://www.xsede.org/ecss
26. The Arabidopsis Information Resource (TAIR). Home Page. http://www.arabidopsis.org
27. NCGAS. National Center for Genome Analysis Support (NCGAS). Home Page. http://ncgas.org
28. Wilkins-Diehr, N. 2007. Special Issue: Science Gateways --- Common Community Interfaces to Grid Resources: Editorials. Concurr. Comput. : Pract. Exper., 19(6), 743--749. http://dl.acm.org/citation.cfm?id=1232528
29. XSEDE. XSEDE Campus Champions. http://www.xsede.org/campus-champions
30. XSEDE. XSEDE Conferences. https://conferences.xsede.org
31. Venkatesh, V., Morris, M. G., Davis, F. D., Davis, G. B. 2003. User Acceptance of Information Technology: Toward a Unified View. MIS Quarterly, 27(3), 425--478. http://csdltechreports.googlecode.com/svn/trunk/techreports/2005/05-06/doc/Venkatesh2003.pdf
32. O'Hara, M., C. Yao and M. Ye. What's Not There: Odd Lots and Market Data. 2014. The Journal of Finance, 69(5), 2199--2236. http://onlinelibrary.wiley.com/doi/10.1111/jofi.12185/abstract

Index Terms

• General and reference

  • Cross-computing tools and techniques

    • Metrics

• Social and professional topics

  • Professional topics

    • Management of computing and information systems

      • System management

        • Technology audits