Abstract
Machine-to-Machine communication (M2M) is nowadays increasingly becoming a world-wide network of interconnected devices uniquely addressable, via standard communication protocols. The prevalence of M2M is bound to generate a massive volume of heterogeneous, multisource, dynamic, and sparse data, which leads a system towards major computational challenges, such as, analysis, aggregation, and storage. Moreover, a critical problem arises to extract the useful information in an efficient manner from the massive volume of data. Hence, to govern an adequate quality of the analysis, diverse and capacious data needs to be aggregated and fused. Therefore, it is imperative to enhance the computational efficiency for fusing and analyzing the massive volume of data. Therefore, to address these issues, this article proposes an efficient, multidimensional, big data analytical architecture based on the fusion model. The basic concept implicates the division of magnitudes (attributes), i.e., big datasets with complex magnitudes can be altered into smaller data subsets using five levels of the fusion model that can be easily processed by the Hadoop Processing Server, resulting in formalizing the problem of feature extraction applications using earth observatory system, social networking, or networking applications. Moreover, a four-layered network architecture is also proposed that fulfills the basic requirements of the analytical architecture. The feasibility and efficiency of the proposed algorithms used in the fusion model are implemented on Hadoop single-node setup on UBUNTU 14.04 LTS core i5 machine with 3.2GHz processor and 4GB memory. The results show that the proposed system architecture efficiently extracts various features (such as land and sea) from the massive volume of satellite data.
- Divyakant Agrawal, Sudipto Das, and Amr El Abbadi. 2011. Big data and cloud computing: current state and future opportunities. In Proceedings of the 14th International Conference on Extending Database Technology. ACM, 530--533. Google Scholar
Digital Library
- Awais Ahmad, Alfred Daniel, and Anand Paul. 2014. Optimized data transmission using cooperative devices in clustered D2D communication. In Proceedings of the 2014 Conference on Research in Adaptive and Convergent Systems. ACM, 209--214. Google Scholar
Digital Library
- Awais Ahmad, Anand Paul, and M. Mazhar Rathore. 2016. An efficient divide-and-conquer approach for big data analytics in machine-to-machine communication. Neurocomputing 174, Part A, 439--453. Google Scholar
Digital Library
- Awais Ahmad, Anand Paul, M. Mazhar Rathore, and Seungmin Rho. 2015. Power aware mobility management of M2M for IoT communications. Mobile Information Systems 501, 521093. Volume 2015, pages 14. DOI: http://dx.doi.org/10.1155/2015/521093Google Scholar
- Oresti Banos, Rafael Garcia, Juan A. Holgado-Terriza, Miguel Damas, Hector Pomares, Ignacio Rojas, Alejandro Saez, and Claudia Villalonga. 2014. mHealthDroid: A novel framework for agile development of mobile health applications. In Ambient Assisted Living and Daily Activities. Springer, 91--98.Google Scholar
- Kelli A. C. Baumgartner, Silvia Ferrari, and Anil V. Rao. 2009. Optimal control of an underwater sensor network for cooperative target tracking. IEEE Journal of Oceanic Engineering 34, 4, 678--697.Google Scholar
Cross Ref
- Cyril Cecchinel, Matthieu Jimenez, Sébastien Mosser, and Michel Riveill. 2014. An architecture to support the collection of big data in the Internet of Things. In Proceedings of the IEEE World Congress on Services (SERVICES). IEEE, 442--449. Google Scholar
Digital Library
- Turgay Celik and Kai-Kuang Ma. 2010. Unsupervised change detection for satellite images using dual-tree complex wavelet transform. IEEE Transactions on Geoscience and Remote Sensing 48, 3, 1199--1210.Google Scholar
Cross Ref
- Jeffrey Cohen, Brian Dolan, Mark Dunlap, Joseph M. Hellerstein, and Caleb Welton. MAD skills: new analysis practices for big data. Proceedings of the VLDB Endowment 2, 2, 1481--1492. Google Scholar
Digital Library
- Graham Cormode and Minos Garofalakis. 2010. Histograms and wavelets on probabilistic data. , IEEE Transactions on Knowledge and Data Engineering 22, 8, 1142--1157. Google Scholar
Digital Library
- Matthew S. Crouse, Robert D. Nowak, and Richard G. Baraniuk. 1998. Wavelet-based statistical signal processing using hidden Markov models. IEEE Transactions on Signal Processing 46, 4, 886--902. Google Scholar
Digital Library
- Alfredo Cuzzocrea, Domenico Saccà, and Jeffrey D. Ullman. 2013. Big data: A research agenda. In Proceedings of the 17th International Database Engineering & Applications Symposium. ACM, 198--203. Google Scholar
Digital Library
- Belur V. Dasarathy. Sensor fusion potential exploitation-innovative architectures and illustrative applications. Proceedings of the IEEE 85, 1, 24--38.Google Scholar
- Jeffrey Dean and Sanjay Ghemawat. 2008. MapReduce: simplified data processing on large clusters. Communications of the ACM 51, 1, 107--113. Google Scholar
Digital Library
- C. Eaton, D. Deroos, T. Deutsch, G. Lapis and P. C. Zikopoulos. 2012. Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data. McGraw-Hill.Google Scholar
- EnviSat, A. S. A. R. 2007. Product Handbook. European Space Agency 2.2.Google Scholar
- European Space Agency (ESA). 2014a. Earth Online. Retrieved from https://earth.esa.int/.Google Scholar
- European Space Agency (ESA). 2014b. The Beam Project. Retrieved from http://www.brockmann-consult.de/cms/web/beam/.Google Scholar
- Maria González-Audícana, José Luis Saleta, Raquel García Catalán, and Rafael García. 2004. Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition. IEEE Transactions on Geoscience and Remote Sensing 42, 6, 1291--1299.Google Scholar
Cross Ref
- Nicolas Haderer, Romain Rouvoy, and Lionel Seinturier. 2013. Dynamic deployment of sensing experiments in the wild using smartphones. In Distributed Applications and Interoperable Systems. Springer, Berlin, 43--56.Google Scholar
- John Heidemann, Fabio Silva, Chalermek Intanagonwiwat, Ramesh Govindan, Deborah Estrin, and Deepak Ganesan. 2001. Building efficient wireless sensor networks with low-level naming. ACM SIGOPS Operating Systems Review 35, 5, 146--159. Google Scholar
Digital Library
- Herodotos Herodotou, Harold Lim, Gang Luo, Nedyalko Borisov, Liang Dong, Fatma Bilgen Cetin, and Shivnath Babu. 2011. Starfish: A self-tuning system for big data analytics. In CIDR. vol. 11, 261--272.Google Scholar
- Chalermek Intanagonwiwat, Deborah Estrin, Ramesh Govindan, and John Heidemann. 2002. Impact of network density on data aggregation in wireless sensor networks. In Proceedings. 22nd International Conference on Distributed Computing Systems. IEEE, 457--458. Google Scholar
Digital Library
- Tzu-Chuan Juan, Shih-En Wei, and Hung-Yun Hsieh. 2013. Data-centric clustering for data gathering in machine-to-machine wireless networks. In Proceedings of the 2013 IEEE International Conference on Communications Workshops (ICC). IEEE, 89--94.Google Scholar
Cross Ref
- A. Kleiner, A. Talwalkar, P. Sarkar, and M. I. Jordan. 2012. The big data bootstrap. In Proceedings of the 29th Internatinoal Conference on Machine Learning. 1--8.Google Scholar
- Alexandros Labrinidis and H. V. Jagadish. 2012. Challenges and opportunities with big data. Proceedings of the VLDB Endowment 5, 12, 2032--2033. Google Scholar
Digital Library
- Runze Li, Dennis K. J. Lin, and Bing Li. 2013. Statistical inference in massive data sets. Applied Stochastic Models in Business and Industry 29, 5, 399--409.Google Scholar
- Xiaoquan Li, Fujiang Zhang, and Yongliang Wang. 2013. Research on big data architecture, key technologies and its measures. In Proceedings of the 2013 IEEE 11th International Conference on Dependable, Autonomic and Secure Computing (DASC). IEEE, 1--4. Google Scholar
Digital Library
- Chung-Chih Liu, Ming-Jang Chiu, Chun-Chieh Hsiao, Ren-Guey Lee, and Yuh-Show Tsai. 2006. Wireless health care service system for elderly with dementia. IEEE Transactions on Information Technology in Biomedicine 10, 4, 696--704. Google Scholar
Digital Library
- Juan Liu and Pierre Moulin. 2001. Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients. IEEE Transactions on Image Processing 10, 11, 1647--1658. Google Scholar
Digital Library
- Peng Liu and Kie B. Eom. 2013. Restoration of multispectral images by total variation with auxiliary image. Optics and Lasers in Engineering 51, 7, 873--882.Google Scholar
Cross Ref
- Peng Liu, Fang Huang, Guoqing Li, and Zhiwen Liu. 2012. Remote-sensing image denoising using partial differential equations and auxiliary images as priors. IEEE Geoscience and Remote Sensing Letters 9, 3, 358--362.Google Scholar
Cross Ref
- Jianguo Lu and Dingding Li. 2013. Bias correction in a small sample from big data. IEEE Transactions on Knowledge and Data Engineering 25, 11, 2658--2663. Google Scholar
Digital Library
- Wald Lucien. 1999. Some terms of reference in data fusion. IEEE Transactions on Geosciences and Remote Sensing 37, 3, 1190--1193.Google Scholar
Cross Ref
- Stephane G. Mallat. 1989. A theory for multiresolution signal decomposition: the wavelet representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 11, 7, 674--693. Google Scholar
Digital Library
- Lori Mann Bruce, Cliff H. Koger, and Jiang Li. 2002. Dimensionality reduction of hyperspectral data using discrete wavelet transform feature extraction. IEEE Transactions on Geoscience and Remote Sensing 40, 10, 2331--2338.Google Scholar
Cross Ref
- Samuel Marchal, Xiuyan Jiang, Radu State, and Thomas Engel. 2014. A big data architecture for large scale security monitoring. In Proceedings of the 2014 IEEE International Congress on Big Data. IEEE, 56--63. Google Scholar
Digital Library
- Samuel Marchal, Xiuyan Jiang, Radu State, and Thomas Engel. 2014. A big data architecture for large scale security monitoring. In Proceedings of the 2014 IEEE International Congress on Big Data. IEEE, 56--63. Google Scholar
Digital Library
- M. Mayilvaganan and M. Sabitha. 2013. A cloud-based architecture for Big-Data analytics in smart grid: A proposal. In Proceedings of the 2013 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC). IEEE, 1--4.Google Scholar
- Katina Michael and Keith Miller. 2013. Big data: New opportunities and new challenges [guest editors' introduction]. Computer 46, 6, 22--24. Google Scholar
Digital Library
- Pooja Mishra and Dharmendra Singh. 2014. A statistical-measure-based adaptive land cover classification algorithm by efficient utilization of polarimetric SAR observables. IEEE Transactions on Geoscience and Remote Sensing 52, 5, 2889--2900.Google Scholar
Cross Ref
- Sébastien Mosser, Ivan Logre, Nicolas Ferry, and Philippe Collet. 2013. From sensors to visualization dashboards: Need for language composition. In Proceedings of the 2nd International Workshop on Globalization of Modeling Languages at MODELS. 6.Google Scholar
- Sebastien Mosser, Franck Fleurey, Brice Morin, Franck Chauvel, Arnor Solberg, and Iokanaan Goutier. 2012. Sensapp as a reference platform to support cloud experiments: From the internet of things to the internet of services. In Proceedings of the 2012 14th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC). 400--406. Google Scholar
Digital Library
- F. Nakamura, A. F. Loureiro, and C. Frery. 2007. Data fusion for wireless sensor networks: Methods, models, and classifications. ACM Computing Surveys 39, 3, Article 9. Google Scholar
Digital Library
- Eduardo F. Nakamura, Antonio A. F. Loureiro, and Alejandro C. Frery. 2007. Information fusion for wireless sensor networks: Methods, models, and classifications. ACM Computing Surveys (CSUR) 39, 3, 9. Google Scholar
Digital Library
- Anand Paul and Seungmin Rho. 2015. Probabilistic model for M2M in IoT networking and communication. Telecommunication Systems 62, 1, 59--66. Google Scholar
Digital Library
- Anand Paul, Seungmin Rho, and K. Bharnitharan. 2014. Interactive scheduling for mobile multimedia service in M2M environment. Multimedia Tools and Applications 71, 1, 235--246. Google Scholar
Digital Library
- Anand Paul. 2013. Graph based M2M optimization in an IoT environment. In Proceedings of the 2013 Research in Adaptive and Convergent Systems. ACM, 45--46. Google Scholar
Digital Library
- Anand Paul. 2014. Real-time power management for embedded M2M using intelligent learning methods. ACM Transactions on Embedded Computing Systems (TECS) 13, 5s, 148. Google Scholar
Digital Library
- Zdzisław Pawlak. 2002. Rough set theory and its applications. Journal of Telecommunications and Information Technology 3, 3, 7--10.Google Scholar
- Antonio Plaza, Pablo Martínez, Rosa Pérez, and Javier Plaza. 2004. A quantitative and comparative analysis of endmember extraction algorithms from hyperspectral data. IEEE Transactions on Geoscience and Remote Sensing 42, 3, 650--663.Google Scholar
Cross Ref
- Javier Portilla and Eero P. Simoncelli. 2000. A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision 40, 1, 49--70. Google Scholar
Digital Library
- Lakshmish Ramaswamy, Victor Lawson, and Siva Venkat Gogineni. 2013. Towards a quality-centric big data architecture for federated sensor services. In Proceedings of the 2013 IEEE International Congress on Big Data (BigData Congress). IEEE, 86--93. Google Scholar
Digital Library
- Attila Reiss and Didier Stricker. 2012a. Creating and benchmarking a new dataset for physical activity monitoring. In Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 40. Google Scholar
Digital Library
- Attila Reiss, and Didier Stricker. 2012b. Introducing a new benchmarked dataset for activity monitoring. In Proceedings of the 2012 16th International Symposium on Wearable Computers (ISWC’12). IEEE, 108--109. Google Scholar
Digital Library
- Mikko Rinne, Seppo Törmä, and Esko Nuutila. 2012. SPARQL-based applications for RDF-encoded sensor data. In Proceedings of the 5th International Conference on Semantic Sensor Networks, vol. 904. 81--96. Google Scholar
Digital Library
- Philip E. Ross. 2004. Managing care through the air [remote health monitoring]. IEEE Spectrum 41, 12, 26--31. Google Scholar
Digital Library
- Vijay P. Shah, Nicolas H. Younan, Surya S. Durbha, and Roger L. King. 2010. Feature identification via a combined ICA--wavelet method for image information mining. IEEE Geoscience and Remote Sensing Letters 7, 1, 18--22.Google Scholar
Cross Ref
- R.D. Schneider. 2012. Hadoop for Dummies Special Edition. John Wiley & Sons.Google Scholar
- Wen-Zhan Song, Renjie Huang, Mingsen Xu, Behrooz A. Shirazi, and Richard LaHusen. 2010. Design and deployment of sensor network for real-time high-fidelity volcano monitoring. IEEE Transactions on Parallel and Distributed Systems 21, 11, 1658--1674. Google Scholar
Digital Library
- David R. Thompson, Lukas Mandrake, Martha S. Gilmore, and Rebecca Castaño. 2010. Superpixel endmember detection. IEEE Transactions on Geoscience and Remote Sensing 48, 11, 4023--4033.Google Scholar
- Lizhe Wang, Hui Zhong, Rajiv Ranjan, Albert Zomaya, and Peng Liu. 2014. Estimating the statistical characteristics of remote sensing big data in the wavelet transform domain. IEEE Transactions on Emerging Topics in Computing 2, 3, 324--337.Google Scholar
Cross Ref
- Xindong Wu, Xingquan Zhu, Gong-Qing Wu, and Wei Ding. 2014. Data mining with big data. IEEE Transactions on Knowledge and Data Engineering 26, 1, 97--107. Google Scholar
Digital Library
- Chen Yang, Lorenzo Bruzzone, Fengyue Sun, Laijun Lu, Renchu Guan, and Yanchun Liang. 2010. A fuzzy-statistics-based affinity propagation technique for clustering in multispectral images. IEEE Transactions on Geoscience and Remote Sensing 48, 6, 2647--2659.Google Scholar
Cross Ref
- Qiang Yang, Yuqiang Chen, Gui-Rong Xue, Wenyuan Dai, and Yong Yu. 2009. Heterogeneous transfer learning for image clustering via the social web. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. Association for Computational Linguistics, 1--9. Google Scholar
Digital Library
- Xiaomeng Yi, Fangming Liu, Jiangchuan Liu, and Hai Jin. 2014. Building a network highway for big data: architecture and challenges. IEEE Network 28, 4, 5--13.Google Scholar
Cross Ref
- Arkady Zaslavsky, Charith Perera, and Dimitrios Georgakopoulos. 2013. Sensing as a service and big data. arXiv preprint arXiv: 1301.0159.Google Scholar
- Jia Zhang, Bob Iannucci, Mark Hennessy, Kartik Gopal, Sean Xiao, Sudhakar Kumar, David Pfeffer, et al. 2013. Sensor data as a service—a federated platform for mobile data-centric service development and sharing. In Proceedings of the 2013 IEEE International Conference on Services Computing (SCC). IEEE, 446--453. Google Scholar
Digital Library
- Jin Zhou, Lei Hu, Feng Wang, Hai-Han Lu, and Kai Zhao. 2013. An efficient multidimensional fusion algorithm for IoT data based on partitioning. Tsinghua Science and Technology 18, 4, 369--378.Google Scholar
Cross Ref
Index Terms
An Efficient Multidimensional Big Data Fusion Approach in Machine-to-Machine Communication
Recommendations
Urban big data fusion based on deep learning: An overview
Highlights- Spatio-temporal data and common data fusion methods are systematically reviewed.
AbstractUrban big data fusion creates huge values for urban computing in solving urban problems. In recent years, various models and algorithms based on deep learning have been proposed to unlock the power of knowledge from urban big data. To ...
An efficient divide-and-conquer approach for big data analytics in machine-to-machine communication
Machine-to-Machine (M2M) communication relies on the physical objects (e.g., satellites, sensors, and so forth) interconnected with each other, creating mesh of machines producing massive volume of data about large geographical area (e.g., living and ...
Service-Generated Big Data and Big Data-as-a-Service: An Overview
BIGDATACONGRESS '13: Proceedings of the 2013 IEEE International Congress on Big DataWith the prevalence of service computing and cloud computing, more and more services are emerging on the Internet, generating huge volume of data, such as trace logs, QoS information, service relationship, etc. The overwhelming service-generated data ...






Comments