skip to main content
10.1145/3267955.3267967acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article

NDN, CoAP, and MQTT: a comparative measurement study in the IoT

Published: 21 September 2018 Publication History
  • Get Citation Alerts
  • Abstract

    This paper takes a comprehensive view on the protocol stacks that are under debate for a future Internet of Things (IoT). It addresses the holistic question of which solution is beneficial for common IoT use cases. We deploy NDN and the two popular IP-based application protocols, CoAP and MQTT, in its different variants on a large-scale IoT testbed in single- and multi-hop scenarios. We analyze the use cases of scheduled periodic and unscheduled traffic under varying loads. Our findings indicate that (a) NDN admits the most resource-friendly deployment on nodes, and (b) shows superior robustness and resilience in multi-hop scenarios, while (c) the IP protocols operate at less overhead and higher speed in single-hop deployments. Most strikingly we find that NDN-based protocols are in significantly better flow balance than the UDP-based IP protocols and require fewer corrective actions.

    References

    [1]
    ACM. Jan., 2017. Result and Artifact Review and Badging. http://acm.org/publications/policies/artifact-review-badging.
    [2]
    Bengt Ahlgren, Christian Dannewitz, Claudio Imbrenda, Dirk Kutscher, and Börje Ohlman. 2012. A Survey of Information-Centric Networking. IEEE Communications Magazine 50, 7 (July 2012), 26--36.
    [3]
    Bengt Ahlgren, Anders Lindgren, and Yanqiu Wu. 2016. Demo: Experimental Feasibility Study of CCN-lite on Contiki Motes for IoT Data Streams. In Proceedings of the 2016 conference on 3rd ACM Conference on Information-Centric Networking. ACM, New York, NY, USA, 221--222.
    [4]
    M. Amadeo, C. Campolo, A. Iera, and A. Molinaro. 2014. Named data networking for IoT: An architectural perspective. In 2014 European Conference on Networks and Communications (EuCNC). IEEE, Piscataway, NJ, USA, 1--5.
    [5]
    M. Amadeo, C. Campolo, A. Iera, and A. Molinaro. 2015. Information Centric Networking in IoT scenarios: The case of a smart home. In Proc. of IEEE International Conference on Communications (ICC). IEEE, Piscataway, NJ, USA, 648--653.
    [6]
    Onur Ascigil, Sergi Reñé, George Xylomenos, Ioannis Psaras, and George Pavlou. 2017. A Keyword-based ICN-IoT Platform. In Proc. of 4th ACM Conference on Information-Centric Networking (ICN). ACM, New York, NY, USA, 22--28.
    [7]
    Atmel. 2009. Low Power 2.4 GHz Transceiver for ZigBee, IEEE 802.15.4, 6LoWPAN, RF4CE, SP100, WirelessHART, and ISM Applications. Atmel Corporation. http://www.atmel.com/images/doc8111.pdf
    [8]
    Emmanuel Baccelli, Cenk Gündogan, Oliver Hahm, Peter Kietzmann, Martine Lenders, Hauke Petersen, Kaspar Schleiser, Thomas C. Schmidt, and Matthias Wählisch. 2018. RIOT: an Open Source Operating System for Low-end Embedded Devices in the IoT. The IEEE Internet of Things Journal (2018).
    [9]
    Emmanuel Baccelli, Oliver Hahm, Mesut Günes, Matthias Wählisch, and Thomas C. Schmidt. 2013. RIOT OS: Towards an OS for the Internet of Things. In Proc. of the 32nd IEEE INFOCOM. Poster. IEEE Press, Piscataway, NJ, USA, 79--80.
    [10]
    Emmanuel Baccelli, Christian Mehlis, Oliver Hahm, Thomas C. Schmidt, and Matthias Wählisch. 2014. Information Centric Networking in the IoT: Experiments with NDN in the Wild. In Proc. of 1st ACM Conf. on Information-Centric Networking (ICN-2014). ACM, New York, 77--86.
    [11]
    Andrew Banks and Rahul Gupta (Eds.). 2014. MQTT Version 3.1.1. OASIS Standard. OASIS. http://docs.oasis-open.org/mqtt/mqtt/v3.1.1/os/mqtt-v3.1.1-os.html
    [12]
    C. Bormann. 2014. 6LoWPAN-GHC: Generic Header Compression for IPv6 over Low-Power Wireless Personal Area Networks (6LoWPANs). RFC 7400. IETF.
    [13]
    C. Bormann, M. Ersue, and A. Keranen. 2014. Terminology for Constrained-Node Networks. RFC 7228. IETF.
    [14]
    Jeff Burke, Paolo Gasti, Naveen Nathan, and Gene Tsudik. 2013. Securing Instrumented Environments over Content-Centric Networking: the Case of Lighting Control and NDN. In Computer Communications Workshops (INFOCOM WKSHPS), 2013 IEEE Conference on. IEEE, Piscataway, NJ, USA, 394--398.
    [15]
    Jiachen Chen, Mayutan Arumaithurai, Lei Jiao, Xiaoming Fu, and Kadangode Ramakrishnan. 2011. COPSS: An Efficient Content Oriented Publish/Subscribe System. In ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS'11). IEEE Computer Society, Los Alamitos, CA, USA, 99--110.
    [16]
    Yuang Chen and Thomas Kunz. 2016. Performance evaluation of IoT protocols under a constrained wireless access network. In International Conference on Selected Topics in Mobile & Wireless Networking (MoWNeT). IEEE, Piscataway, NJ, USA, 1--7.
    [17]
    Jasenka Dizdarevic, Francisco Carpio, Admela Jukan, and Xavi Masip-Bruin. 2018. Survey of Communication Protocols for Internet-of-Things and Related Challenges of Fog and Cloud Computing Integration. Technical Report 1804.01747. ArXiv e-prints.
    [18]
    Asma Elmangoush, Ronald Steinke, Thomas Magedanz, Andreea Ancuta Corici, Alex Bourreau, and Adel Al-Hezmi. 2015. Application-derived communication protocol selection in M2M platforms for smart cities. In Proc. of 18th International Conference on Intelligence in Next Generation Networks (ICIN). IEEE, Piscataway, NJ, USA, 76--82.
    [19]
    Nikos Fotiou, Hasan Islam, Dmitrij Lagutin, Teemu Hakala, and George C. Polyzos. 2016. CoAP over ICN. In Proc. of IFIP NTMS. IEEE, Piscataway, NJ, USA, 1--4.
    [20]
    Nikos Fotiou, George Xylomenos, George C. Polyzos, Hasan Islam, Dmitrij Lagutin, Teemu Hakala, and Eero Hakala. 2017. ICN Enabling CoAP Extensions for IP Based IoT Devices. In Proc. of ACM ICN. ACM, New York, NY, USA, 218--219.
    [21]
    J. J. Garcia-Luna-Aceves. 2017. ADN: An Information-Centric Networking Architecture for the Internet of Things. In Proc. of the 2nd International Conference on Internet-of-Things Design and Implementation (IoTDI '17). ACM, New York, NY, USA, 27--36.
    [22]
    Mark Gritter and David R. Cheriton. 2001. An Architecture for Content Routing Support in the Internet. In Proc. USITS'01. USENIX Association, Berkeley, CA, USA, 4--4.
    [23]
    Cenk Gündogan, Peter Kietzmann, Thomas C. Schmidt, Martine Lenders, Hauke Petersen, Matthias Wählisch, Michael Frey, and Felix Shzu-Juraschek. 2017. Information-Centric Networking for the Industrial IoT. In Proc. of 4th ACM Conference on Information-Centric Networking (ICN), Demo Session. ACM, New York, NY, USA, 214--215.
    [24]
    Cenk Gündogan, Peter Kietzmann, Thomas C. Schmidt, and Matthias Wählisch. 2018. HoPP: Robust and Resilient Publish-Subscribe for an Information-Centric Internet of Things. In Proc. of the 43rd IEEE Conference on Local Computer Networks (LCN). IEEE Press, Piscataway, NJ, USA. Accepted for publication.
    [25]
    Cenk Gündogan, Thomas C. Schmidt, Matthias Wählisch, Christopher Scherb, Claudio Marxer, and Christian Tschudin. 2018. ICN Adaptation to LowPAN Networks (ICN LoWPAN). IRTF Internet Draft - work in progress 02. IRTF. https://tools.ietf.org/html/draft-gundogan-icnrg-ccnlowpan
    [26]
    Oliver Hahm, Cédric Adjih, Emmanuel Baccelli, Thomas C. Schmidt, and Matthias Wählisch. 2016. ICN over TSCH: Potentials for Link-Layer Adaptation in the IoT. In Proc. of 3rd ACM Conf. on Information-Centric Networking (ICN 2016), Poster Session. ACM, New York, NY, USA, 195--196. Best Poster Award.
    [27]
    Oliver Hahm, Emmanuel Baccelli, Thomas C. Schmidt, Matthias Wählisch, Cedric Adjih, and Laurent Massoulié. 2017. Low-power Internet of Things with NDN and Cooperative Caching. In Proc. of 4th ACM Conference on Information-Centric Networking (ICN). ACM, New York, NY, USA, 98--108.
    [28]
    K. Hartke. 2015. Observing Resources in the Constrained Application Protocol (CoAP). RFC 7641. IETF.
    [29]
    Markel Iglesias-Urkia, Adrián Orive, and Aitor Urbieta. 2017. Analysis of CoAP Implementations for Industrial Internet of Things: A Survey. Procedia Computer Science 109 (2017), 188--195.
    [30]
    Hasan Islam, Dmitrij Lagutin, and Nikos Fotiou. 2017. Observing IoT Resources over ICN. In Proc. of IFIP Networking Workshop on Information-Centric Fog Computing. IEEE, Piscataway, NJ, USA, 1--8.
    [31]
    Van Jacobson, Diana K. Smetters, James D. Thornton, and Michael F. Plass. 2009. Networking Named Content. In 5th Int. Conf. on emerging Networking Experiments and Technologies (ACM CoNEXT'09). ACM, New York, NY, USA, 1--12.
    [32]
    José Quevedo and Rui Ferreira and Carlos Guimarães and Rui L. Aguiar and Daniel Corujo. 2017. Internet of Things discovery in interoperable Information Centric and IP networks. Internet Technology Letters 1 (2017), 1--6. Issue 1.
    [33]
    Peter Kietzmann, Cenk Gündogan, Thomas C. Schmidt, Oliver Hahm, and Matthias Wählisch. 2017. The Need for a Name to MAC Address Mapping in NDN: Towards Quantifying the Resource Gain. In Proc. of 4th ACM Conference on Information-Centric Networking (ICN). ACM, New York, NY, USA, 36--42.
    [34]
    Teemu Koponen, Mohit Chawla, Byung-Gon Chun, Andrey Ermolinskiy, Kye Hyun Kim, Scott Shenker, and Ion Stoica. 2007. A Data-Oriented (and beyond) Network Architecture. SIGCOMM Computer Communications Review 37, 4 (2007), 181--192.
    [35]
    Carel P. Kruger and Gerhard P. Hancke. 2014. Benchmarking Internet of things devices. In Proc. of 12th IEEE International Conf on Industrial Informatics (INDIN). IEEE, Piscataway, NJ, USA, 611--616.
    [36]
    D. Kutscher, S. Eum, K. Pentikousis, I. Psaras, D. Corujo, D. Saucez, T. Schmidt, and M. Waehlisch. 2016. Information-Centric Networking (ICN) Research Challenges. RFC 7927. IETF.
    [37]
    Martine Lenders, Peter Kietzmann, Oliver Hahm, Hauke Petersen, Cenk Gündogan, Emmanuel Baccelli, Kaspar Schleiser, Thomas C. Schmidt, and Matthias Wählisch. 2018. Connecting the World of Embedded Mobiles: The RIOT Approach to Ubiquitous Networking for the Internet of Things. Technical Report arXiv:1801.02833. Open Archive: arXiv.org. https://arxiv.org/abs/1801.02833
    [38]
    Christian Lerche, Klaus Hartke, and Matthias Kovatsch. 2012. Industry adoption of the Internet of Things: A constrained application protocol survey. In Proc. 17th IEEE International Conf on Emerging Technologies & Factory Automation (ETFA). IEEE, Piscataway, NJ, USA, 1--6.
    [39]
    Alessandro Ludovici, Pol Moreno, and Anna Calveras. 2013. Tiny-CoAP: A Novel Constrained Application Protocol (CoAP) Implementation for Embedding RESTful Web Services in Wireless Sensor Networks Based on TinyOS. J. Sensor and Actuator Networks 2, 2 (2013), 288--315.
    [40]
    A. Markkanen and D. Shey. 2015. Edge Analytics in IoT. Technical Report. ABI Research.
    [41]
    Bertrand Mathieu, Cedric Westphal, and Patrick Truong. 2016. Towards the Usage of CCN for IoT Networks. In Internet of Things (IoT) in 5G Mobile Technologies. Springer, Cham, Switzerland, 3--24.
    [42]
    G. Montenegro, N. Kushalnagar, J. Hui, and D. Culler. 2007. Transmission of IPv6 Packets over IEEE 802.15.4 Networks. RFC 4944. IETF.
    [43]
    S. Y. Oh, D. Lau, and M. Gerla. 2010. Content Centric Networking in tactical and emergency MANETs. In 2010 IFIP Wireless Days. IEEE, Piscataway, NJ, USA, 1--5.
    [44]
    George C. Polyzos and Nikos Fotiou. 2015. Building a reliable Internet of Things using Information-Centric Networking. Journal of Reliable Intelligent Environments 1, 1 (2015), 47--58.
    [45]
    E. Rescorla and N. Modadugu. 2012. Datagram Transport Layer Security Version 1.2. RFC 6347. IETF.
    [46]
    Divya Saxena, Vaskar Raychoudhury, and Nalluri SriMahathi. 2015. SmartHealth-NDNoT: Named Data Network of Things for Healthcare Services. In Proc. of Workshop on Pervasive Wireless Healthcare (MobileHealth). ACM, New York, NY, USA, 45--50.
    [47]
    Quirin Scheitle, Matthias Wählisch, Oliver Gasser, Thomas C. Schmidt, and Georg Carle. 2017. Towards an Ecosystem for Reproducible Research in Computer Networking. In Proc. of ACM SIGCOMM Reproducibility Workshop. ACM, New York, NY, USA, 5--8.
    [48]
    Thomas C. Schmidt, Sebastian Wölke, Nora Berg, and Matthias Wählisch. 2016. Let's Collect Names: How PANINI Limits FIB Tables in Name Based Routing. In Proc. of 15th IFIP Networking Conference. IEEE Press, Piscataway, NJ, USA, 458--466.
    [49]
    E. M. Schooler, D. Zage, J. Sedayao, H. Moustafa, A. Brown, and M. Ambrosin. 2017. An Architectural Vision for a Data-Centric IoT: Rethinking Things, Trust and Clouds. In IEEE 37th Intern. Conference on Distributed Computing Systems (ICDCS). IEEE, Piscataway, NJ, USA, 1717--1728.
    [50]
    Wenato Shang, Alex Afanasyev, and Lixia Zhang. 2016. The Design and Implementation of the NDN Protocol Stack for RIOTOS. In Proc. of IEEE GLOBECOM 2016. IEEE, Washington, DC, USA, 1--6.
    [51]
    Wentao Shang, Adeola Bannis, Teng Liang, Zhehao Wang, Yingdi Yu, Alexander Afanasyev, Jeff Thompson, Jeff Burke, Beichuan Zhang, and Lixia Zhang. 2016. Named Data Networking of Things (Invited Paper). In Proc. of IEEE International Conf. on Internet-of-Things Design and Implementation (IoTDI). IEEE Computer Society, Los Alamitos, CA, USA, 117--128.
    [52]
    Wentao Shang, Yingdi Yu, Teng Liang, Beichuan Zhang, and Lixia Zhang. 2015. NDN-ACE: Access Control for Constrained Environments over Named Data Networking. Technical Report NDN-0036. NDN.
    [53]
    Z. Shelby, K. Hartke, and C. Bormann. 2014. The Constrained Application Protocol (CoAP). RFC 7252. IETF.
    [54]
    Junxiao Shi and Beichuan Zhang. 2012. NDNLP: A Link Protocol for NDN. NDN, Technical Report NDN-0006. NDN Team.
    [55]
    Andy Stanford-Clark and Hong Linh Truong. 2013. MQTT For Sensor Networks (MQTT-SN) Version 1.2. Protocol Specification. IBM. http://mqtt.org/new/wp-content/uploads/2009/06/MQTT-SN_spec_v1.2.pdf
    [56]
    Sridhar Srinivasa Subramanian, Joseph Pasquale, and George C. Polyzos. 2017. CoAP for Content-Centric Networks. In Proc. of IEEE CCNC. IEEE, Piscataway, NJ, USA, 467--472.
    [57]
    Dinesh Thangavel, Xiaoping Ma, Alvin Valera, Hwee-Xian Tan, and Colin Keng-Yan Tan. 2014. Performance evaluation of MQTT and CoAP via a common middleware. In Proc. of ISSNIP. IEEE, Piscataway, NJ, USA, 1--6.
    [58]
    Christian Tschudin, Christopher Scherb, et al. 2018. CCN Lite: Lightweight implementation of the Content Centric Networking protocol. http://ccn-lite.net
    [59]
    Berta Carballido Villaverde, Dirk Pesch, Rodolfo de Paz Alberola, Szymon Fedor, and Menouer Boubekeur. 2012. Constrained Application Protocol for Low Power Embedded Networks: A Survey. In Proc. of 6th International Conf on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS). IEEE Computer Society, Washington, DC, USA, 702--707.
    [60]
    Matthias Wählisch, Thomas C. Schmidt, and Markus Vahlenkamp. 2012. Bulk of Interest: Performance Measurement of Content-Centric Routing. In Proc. of ACM SIGCOMM, Poster Session. ACM, New York, 99--100. http://conferences.sigcomm.org/sigcomm/2012/paper/sigcomm/p99.pdf
    [61]
    Matthias Wählisch, Thomas C. Schmidt, and Markus Vahlenkamp. 2013. Backscatter from the Data Plane - Threats to Stability and Security in Information-Centric Network Infrastructure. Computer Networks 57, 16 (Nov. 2013), 3192--3206.
    [62]
    T. Winter, P. Thubert, A. Brandt, J. Hui, R. Kelsey, P. Levis, K. Pister, R. Struik, JP. Vasseur, and R. Alexander. 2012. RPL: IPv6 Routing Protocol for Low-Power and Lossy Networks. RFC 6550. IETF.
    [63]
    Lixia Zhang, Alexander Afanasyev, Jeffrey Burke, Van Jacobson, kc claffy, Patrick Crowley, Christos Papadopoulos, Lan Wang, and Beichuan Zhang. 2014. Named Data Networking. SIGCOMM Comput. Commun. Rev. 44, 3 (2014), 66--73.
    [64]
    Minsheng Zhang, Vince Lehman, and Lan Wang. 2017. Scalable name-based data synchronization for named data networking. In IEEE INFOCOM'17 (INFOCOM '17). IEEE Computer Society, Los Alamitos, CA, USA, 1--9.

    Cited By

    View all
    • (2024)A Case Study on Applying MQTT Communication to Improve Cold Storage Safety and Quality ManagementTurkish Journal of Health Science and Life10.56150/tjhsl.14355907:1(33-45)Online publication date: 30-Apr-2024
    • (2023)Analysis and Design of a MuSiC-Based Angle of Arrival Positioning SystemACM Transactions on Sensor Networks10.1145/357792719:3(1-41)Online publication date: 2-Mar-2023
    • (2023)Blockchain-Based Privacy Preservation for IoT-Enabled Healthcare SystemACM Transactions on Sensor Networks10.1145/357792619:3(1-17)Online publication date: 2-Mar-2023
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICN '18: Proceedings of the 5th ACM Conference on Information-Centric Networking
    September 2018
    230 pages
    ISBN:9781450359597
    DOI:10.1145/3267955
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 September 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. energy
    2. internet of things
    3. measurement
    4. protocol evaluation
    5. security
    6. wireless

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    ICN '18
    Sponsor:
    ICN '18: 5th ACM Conference on Information-Centric Networking
    September 21 - 23, 2018
    Massachusetts, Boston

    Acceptance Rates

    ICN '18 Paper Acceptance Rate 17 of 57 submissions, 30%;
    Overall Acceptance Rate 133 of 482 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)77
    • Downloads (Last 6 weeks)6

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A Case Study on Applying MQTT Communication to Improve Cold Storage Safety and Quality ManagementTurkish Journal of Health Science and Life10.56150/tjhsl.14355907:1(33-45)Online publication date: 30-Apr-2024
    • (2023)Analysis and Design of a MuSiC-Based Angle of Arrival Positioning SystemACM Transactions on Sensor Networks10.1145/357792719:3(1-41)Online publication date: 2-Mar-2023
    • (2023)Blockchain-Based Privacy Preservation for IoT-Enabled Healthcare SystemACM Transactions on Sensor Networks10.1145/357792619:3(1-17)Online publication date: 2-Mar-2023
    • (2023)A Flexible and Modular Architecture for Edge Digital Twin: Implementation and EvaluationACM Transactions on Internet of Things10.1145/35732064:1(1-32)Online publication date: 23-Feb-2023
    • (2023)ForETaxi: Data-Driven Fleet-Oriented Charging Resource Allocation in Large-Scale Electric Taxi NetworksACM Transactions on Sensor Networks10.1145/357095819:3(1-25)Online publication date: 2-Mar-2023
    • (2023)An Efficient Data Protection Scheme Based on Hierarchical ID-Based Encryption for MQTTACM Transactions on Sensor Networks10.1145/357050619:3(1-21)Online publication date: 2-Mar-2023
    • (2023)Applying Probabilistic Model Checking to the Behavior Guidance and Abnormality Detection for A-MCI Patients under Wireless Sensor NetworkACM Transactions on Sensor Networks10.1145/349942619:3(1-24)Online publication date: 2-Mar-2023
    • (2023)IoT Data Collection Over Dynamic Networks: A Performance Comparison of NDN, DTN and NoD2023 IEEE 9th World Forum on Internet of Things (WF-IoT)10.1109/WF-IoT58464.2023.10539564(1-6)Online publication date: 12-Oct-2023
    • (2023)Design and Evaluation of an Application-Oriented Data-Centric Communication Framework for Emerging Cyber-Physical Systems2023 IEEE 20th Consumer Communications & Networking Conference (CCNC)10.1109/CCNC51644.2023.10060823(875-878)Online publication date: 8-Jan-2023
    • (2023)Evaluating CoAP, OSCORE, DTLS and HTTPS for Secure Device CommunicationInternet of Everything10.1007/978-3-031-25222-8_10(117-132)Online publication date: 29-Jan-2023
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media