skip to main content
research-article
Open Access

P2P-Based, Multi-Attribute Resource Discovery under Real-World Resources and Queries

Published:12 March 2015Publication History
Skip Abstract Section

Abstract

Collaborative peer-to-peer (P2P), grid, and cloud computing rely on resource discovery (RD) solutions to aggregate groups of multi-attribute, dynamic, and distributed resources. However, specific characteristics of real-world resources and queries, and their impact on P2P-based RD, are largely unknown. We analyze the characteristics of resources and queries using data from four real-world systems. These characteristics are then used to qualitatively and quantitatively evaluate the fundamental design choices for P2P-based multi-attribute RD. The datasets exhibit several noteworthy features that affect the performance. For example, compared to uniform queries, real-world queries are relatively easier to resolve using unstructured, superpeer, and single-attribute-dominated query-based structured P2P solutions, as queries mostly specify only a small subset of the available attributes and large ranges of attribute values. However, all the solutions are prone to significant load balancing issues, as the resources and queries are highly skewed and correlated. The implications of our findings for improving RD solutions are also discussed.

References

  1. Albrecht, J., Oppenheimer, D., Vahdat, A., and Patterson, D. 2008. Design and implementation tradeoffs for wide-area resource discovery. ACM Trans. Internet Technol. 8, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Anderson, D. P. and Fedak, G. 2006. The computational and storage potential of volunteer computing. In Proceedings of the 6th IEEE International Symposium on Cluster Computing and the Grid (CCGRID’06). 73--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Anderson, D. P. and Reed, K. 2009. Celebrating diversity in volunteer computing. In Proceedings of the 42nd Hawaii International Conference on System Sciences (HICSS’09). 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Andrzejak, A., Kondo, D., and Anderson, D. P. 2010. Exploiting non-dedicated resources for cloud computing. In Proceedings of the 12th Network Operations and Management Symposium (NOMS’10). 341--348.Google ScholarGoogle Scholar
  5. Bandara, H. M. N. D. 2012. Enhancing collaborative peer-to-peer systems using resource aggregation and caching: A multi-attribute resource and query aware approach. Ph.D. dissertation, Colorado State University, Fort Collins. http://hdl.handle.net/10217/78733. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Bandara, H. M. N. D. and Jayasumana, A. P. 2011a. On characteristics and modeling of P2P resources with correlated static and dynamic attributes. In Proceedings of the IEEE Global Telecommunications Conference (GLOBECOM’11). 1--6.Google ScholarGoogle Scholar
  7. Bandara, H. M. N. D. and Jayasumana, A. P. 2011b. Characteristics of multi-attribute resources/queries and implications on P2P resource discovery. In Proceedings of the 9th ACS/IEEE International Conference on Computer Systems and Applications (AICCSA’11). 173--180. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Bandara, H. M. N. D. and Jayasumana, A. P. 2012a. Evaluation of P2P resource discovery architectures using real-life multi-attribute resource and query characteristics. In Proceedings of the IEEE Consumer Communications and Networking Conference (CCNC’12). 634--639.Google ScholarGoogle Scholar
  9. Bandara, H. M. N. D. and Jayasumana, A. P. 2012b. Collaborative applications over peer-to-peer systems--Challenges and solutions. Peer-to-Peer Netw. Appl. 6, 3, 257--276.Google ScholarGoogle ScholarCross RefCross Ref
  10. Bandara, H. M. N. D. and Jayasumana, A. P. 2012c. Resource and query aware, peer-to-peer-based multi-attribute resource discovery. In Proceedings of the 37th IEEE Conference on Local Computer Networks (LCN’12). 276--279. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Bandara, H. M. N. D. and Jayasumana, A. P. 2013. Community-based caching for enhanced lookup performance in P2P systems. IEEE Trans. Parallel Distrib. Syst. 24, 9, 1752--1762. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Bharambe, A. R., Agrawal, M., and Seshan, S. 2004. Mercury: Supporting scalable multi-attribute range queries. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOM’04). 353--366. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Briscoe, G. and Marinos, A. 2009. Digital ecosystems in the clouds: Towards community cloud computing. In Proceedings of the 3rd IEEE International Conference on Digital Ecosystems and Technologies (DEST’09). 103--108.Google ScholarGoogle Scholar
  14. Brophy, J. and Bawden, D. 2005. Is Google enough? Comparison of an Internet search engine with academic library resources. Aslib Proc. 57, 6, 498--512.Google ScholarGoogle ScholarCross RefCross Ref
  15. Cai, M., Frank, M., Chen, J., and Szekely, P. 2004. MAAN: A multi-attribute addressable network for grid information services. J. Grid Comput. 2, 1, 3--14.Google ScholarGoogle ScholarCross RefCross Ref
  16. Costa, P., Napper, J., Pierre, G., and Van Steen, M. 2009. Autonomous resource selection for decentralized utility computing. In Proceedings of the 29th IEEE International Conference on Distributed Computing Systems (ICDCS’09). 561--570. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Elliott, C. 2009. GENI: Exploring networks of the future. http://www.geni.net.Google ScholarGoogle Scholar
  18. George, M. 2006. B-A scale-free network generation and visualization. www.mathworks.com/matlabcentral/fileexchange/11947.Google ScholarGoogle Scholar
  19. Germain-Renaud, C., Cady, A., Gauron, P., Jouvin, M., Loomis, C., et al. 2011a. The grid observatory. In Proceedings of the 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID’11). 114--123. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Germain-Renaud, C., Furst, F., Jouvin, M., Kassel, G., Nauroy, J., and Philippon, G. 2011b. The green computing observatory: A data curation approach for green IT. In Proceedings of the 9th IEEE International Conference on Dependable, Autonomic and Secure Computing (DASC’11). 798--799. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Heien, E. M., Kondo, D., and Anderson, D. P. 2012. A correlated resource models of Internet end hosts. IEEE Trans. Parallel Distrib. Syst. 23, 6, 977--984. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Ikeda, S., Kubo, I., and Yamashita, M. 2009. The hitting and cover times of random walks on finite graphs using local degree information. Theor. Comput. Sci. 410, 1, 94--100. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Iosup, A. and Epema, D. 2010. Grid computing workloads: Bags of tasks, workflows, pilots, and others. IEEE Internet Comput. 15, 2, 19--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Kee, Y. S., Casanova, H., and Chien, A. 2004. Realistic modeling and synthesis of resources for computational grids. In Proceedings of the ACM/IEEE Conference on Supercomputing (SC’04). Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Kim, W., Roopakalu, A., Li, K. Y., and Pai, V. S. 2011. Understanding and characterizing PlanetLab resource usage for federated network testbeds. In Proceedings of the Internet Measurement Conference (IMC’11). Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Lazaro, D., Marques, J. M., Jorba, J., and Vilajosana, X. 2013. Decentralized resource discovery mechanisms for distributed computing in peer-to-peer environments. ACM Comput. Surv. 45, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Lee, P., Jayasumana, A. P., Bandara, H. M. N. D., Lim, S., and Chandrasekar, V. 2012. A peer-to-peer collaboration framework for multi-sensor data fusion. J. Netw. Comput. Appl. 35, 3, 1052--1066. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Lu, D. and Dinda, P. A. 2003, Synthesizing realistic computational grids. In Proceedings of the ACM/IEEE Conference on Supercomputing (SC’03). Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Lua, E. K., Crowcroft, J., Pias, M., Sharma, R., and Lim, S. 2004. A survey and comparison of peer-to-peer overlay network schemes. IEEE Comm. Surv. Tutor. 7, 2, 72--93. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Mclaughlin, D. and Chandrasekar, V. 2009. Short-wavelength technology and the potential for distributed networks of small radar systems. Bull. Amer. Meteorolog. Soc. 90, 1797--1817.Google ScholarGoogle ScholarCross RefCross Ref
  31. Newhouse, S. 2011. European grid infrastructure -- An integrated sustainable Pan-European infrastructure for researchers in Europe (EGI-InSPIRE). Tech. rep. EGI-doc-201-v6. http://go.egi.eu/pdnon.Google ScholarGoogle Scholar
  32. Park, K. and Pai, V. S. 2006. CoMon: A mostly-scalable monitoring system for PlanetLab. ACM SIGOPS Oper. Syst. Rev. 40, 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Sahai, A., Singhal, S., Machiraju, V., and Joshi, R. 2004. Automated policy-based resource construction in utility computing environments. In Proceedings of the Network Operations and Management Symposium (NOMS’04). 381--393.Google ScholarGoogle Scholar
  34. Shen, H. 2009. A P2P-based intelligent resource discovery mechanism in Internet-based distributed Systems. J. Parallel Distrib. Comput. 69, 197--209. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Shen, H. and Hwang, K. 2012. Locality-preserving clustering and discovery of resources in wide-area distributed computational grids. IEEE Trans. Comput. 61, 4, 458--473. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Shen, H., Lin, Y., and Li, T. 2013. Combining efficiency, fidelity and flexibility in resource information services. IEEE Trans. Comput. 64, 2, 353--367.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Shen, H. and Xu, C.-Z. 2012. Leveraging a compound graph based DHT for multi-attribute range queries with performance analysis. IEEE Trans. Comput. 61, 4, 433--447. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Stoica, I., Morris, R., Liben-Nowell, D., Karger, D., Kaashoek, M. F., Dabek, F., and Balakrishnan, H. 2003. Chord: A scalable peer-to-peer protocol for Internet applications. IEEE/ACM Trans. Netw. 11, 1, 17--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Sulistio, A., Cibej, U., Venugopal, S., Robic, B., and Buyya, R. 2008. A toolkit for modelling and simulating data grids: An extension to Gridsim. Concurr. Comput. Pract. Exper. 20, 13, 1591--1609. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Tan, Y., Han, J., and Lu, Y. 2008. Agent-based intelligent resource discovery scheme in P2P networks. In Proceedings of the Pacific-Asia Workshop on Computational Intelligence and Industrial Application (PACIIA’08). 752--756. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. P2P-Based, Multi-Attribute Resource Discovery under Real-World Resources and Queries

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in

              Full Access

              • Published in

                cover image ACM Transactions on Internet Technology
                ACM Transactions on Internet Technology  Volume 15, Issue 1
                Special Issue on Foundations of Social Computing
                February 2015
                147 pages
                ISSN:1533-5399
                EISSN:1557-6051
                DOI:10.1145/2745838
                • Editor:
                • Munindar P. Singh
                Issue’s Table of Contents

                Copyright © 2015 ACM

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 12 March 2015
                • Accepted: 1 May 2014
                • Revised: 1 March 2014
                • Received: 1 December 2012
                Published in toit Volume 15, Issue 1

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article
                • Research
                • Refereed

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader
              About Cookies On This Site

              We use cookies to ensure that we give you the best experience on our website.

              Learn more

              Got it!