Big 3D spatial data processing using cloud computing environment

ABSTRACT

Lately, acquiring a large quantity of three-dimensional (3-D) spatial data particularly topographic information has become commonplace with the advent of new technology such as laser scanner or light detection and ranging (LiDAR) and techniques. Though both in the USA and around the globe, the pace of massive 3-D spatial data collection is accelerating, the provision of affordable technology for dealing with issues such as processing, management, archival, dissemination, and analysis of the huge data volumes has lagged behind. Single computers and generic high-end computing are not sufficient to process this massive data and researches started to explore other computing environments. Recently cloud computing environment showed very promising solutions due to availability and affordability. The main goal of this paper is to develop a web-based LiDAR data processing framework called "Cloud Computing-based LiDAR Processing System (CLiPS)" to process massive LiDAR data using cloud computing environment. The CLiPS framework implementation was done using ESRI's ArcGIS server, Amazon Elastic Compute Cloud (Amazon EC2), and several open source spatial tools. Some of the applications developed in this project include: 1) preprocessing tools for LiDAR data, 2) generation of large area Digital Elevation Model (DEMs) on the cloud environment, and 3) user-driven DEM derived products. We have used three different terrain types, LiDAR tile sizes, and EC2 instant types (large, Xlarge, and double Xlarge) to test for time and cost comparisons. Undulating terrain data took more time than other two terrain types used in this study and overall cost for the entire project was less than $100.

References

1. Hodgson, M. E.; Jenson, J. R.; Schmidt, L.; Schill, S.; Davis, B. 2003. An evaluation of lidar- and IFSAR-derived digital elevation models in leaf-on conditions with USGS Level 1 and Level 2 DEMs. Remote Sens. Environ. 84, 295--308.
2. Sugumaran, R., Oryspayev, D., and Gray, P. 2011. GPU-based cloud performance for LiDAR data processing. COM.Geo 2011: 2nd International Conference and Exhibition on Computing for Geospatial Research and Applications, May 23--25, 2011, Wahington DC, USA.
3. Oryspayev, D., Sugumaran, R., DeGroote, J., and Gray, P. 2011. LiDAR data reduction using vertex decimation and processing with GPGPU and multi-core CPU technology. Computers and GeoSciences (Accepted).
4. Han, S. H., Heo, J., Sohn, H. G., and Yu, K. 2009. Parallel Processing Method for Airborne Laser Scanning Data Using a PC Cluster and a Virtual Grid. Sensors 2009, 9 (4): 2555--2573; doi:10.3390/s90402555.
5. Krishnan, S., Bary, C., Crosby, C., 2010. Evaluation of MapReduce for Gridding LIDAR Data, CloudCom, pp. 33--40, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.
6. Iowa Lidar Mapping Project (ILMP), GeoInformatics Training, Research, Education, and Extension (GeoTRE) Center of University of Northern Iowa, http://geotree2.geog.uni.edu/lidar/ Accessed on August 30, 2012.
7. LAStools. http://www.cs.unc.edu/~isenburg/lastools/ Accessed on February 11, 2011.

Index Terms

• Computer systems organization

  • Architectures

    • Distributed architectures

• Human-centered computing

  • Visualization

    • Visualization application domains

      • Geographic visualization

• Information systems

  • Information systems applications

    • Spatial-temporal systems

• Software and its engineering

  • Software organization and properties

    • Software system structures

      • Distributed systems organizing principles