Abstract
Collaborative peer-to-peer (P2P), grid, and cloud computing rely on resource discovery (RD) solutions to aggregate groups of multi-attribute, dynamic, and distributed resources. However, specific characteristics of real-world resources and queries, and their impact on P2P-based RD, are largely unknown. We analyze the characteristics of resources and queries using data from four real-world systems. These characteristics are then used to qualitatively and quantitatively evaluate the fundamental design choices for P2P-based multi-attribute RD. The datasets exhibit several noteworthy features that affect the performance. For example, compared to uniform queries, real-world queries are relatively easier to resolve using unstructured, superpeer, and single-attribute-dominated query-based structured P2P solutions, as queries mostly specify only a small subset of the available attributes and large ranges of attribute values. However, all the solutions are prone to significant load balancing issues, as the resources and queries are highly skewed and correlated. The implications of our findings for improving RD solutions are also discussed.
- Albrecht, J., Oppenheimer, D., Vahdat, A., and Patterson, D. 2008. Design and implementation tradeoffs for wide-area resource discovery. ACM Trans. Internet Technol. 8, 4. Google Scholar
Digital Library
- Anderson, D. P. and Fedak, G. 2006. The computational and storage potential of volunteer computing. In Proceedings of the 6th IEEE International Symposium on Cluster Computing and the Grid (CCGRID’06). 73--80. Google Scholar
Digital Library
- Anderson, D. P. and Reed, K. 2009. Celebrating diversity in volunteer computing. In Proceedings of the 42nd Hawaii International Conference on System Sciences (HICSS’09). 1--8. Google Scholar
Digital Library
- Andrzejak, A., Kondo, D., and Anderson, D. P. 2010. Exploiting non-dedicated resources for cloud computing. In Proceedings of the 12th Network Operations and Management Symposium (NOMS’10). 341--348.Google Scholar
- Bandara, H. M. N. D. 2012. Enhancing collaborative peer-to-peer systems using resource aggregation and caching: A multi-attribute resource and query aware approach. Ph.D. dissertation, Colorado State University, Fort Collins. http://hdl.handle.net/10217/78733. Google Scholar
Digital Library
- Bandara, H. M. N. D. and Jayasumana, A. P. 2011a. On characteristics and modeling of P2P resources with correlated static and dynamic attributes. In Proceedings of the IEEE Global Telecommunications Conference (GLOBECOM’11). 1--6.Google Scholar
- Bandara, H. M. N. D. and Jayasumana, A. P. 2011b. Characteristics of multi-attribute resources/queries and implications on P2P resource discovery. In Proceedings of the 9th ACS/IEEE International Conference on Computer Systems and Applications (AICCSA’11). 173--180. Google Scholar
Digital Library
- Bandara, H. M. N. D. and Jayasumana, A. P. 2012a. Evaluation of P2P resource discovery architectures using real-life multi-attribute resource and query characteristics. In Proceedings of the IEEE Consumer Communications and Networking Conference (CCNC’12). 634--639.Google Scholar
- Bandara, H. M. N. D. and Jayasumana, A. P. 2012b. Collaborative applications over peer-to-peer systems--Challenges and solutions. Peer-to-Peer Netw. Appl. 6, 3, 257--276.Google Scholar
Cross Ref
- Bandara, H. M. N. D. and Jayasumana, A. P. 2012c. Resource and query aware, peer-to-peer-based multi-attribute resource discovery. In Proceedings of the 37th IEEE Conference on Local Computer Networks (LCN’12). 276--279. Google Scholar
Digital Library
- Bandara, H. M. N. D. and Jayasumana, A. P. 2013. Community-based caching for enhanced lookup performance in P2P systems. IEEE Trans. Parallel Distrib. Syst. 24, 9, 1752--1762. Google Scholar
Digital Library
- Bharambe, A. R., Agrawal, M., and Seshan, S. 2004. Mercury: Supporting scalable multi-attribute range queries. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOM’04). 353--366. Google Scholar
Digital Library
- Briscoe, G. and Marinos, A. 2009. Digital ecosystems in the clouds: Towards community cloud computing. In Proceedings of the 3rd IEEE International Conference on Digital Ecosystems and Technologies (DEST’09). 103--108.Google Scholar
- Brophy, J. and Bawden, D. 2005. Is Google enough? Comparison of an Internet search engine with academic library resources. Aslib Proc. 57, 6, 498--512.Google Scholar
Cross Ref
- Cai, M., Frank, M., Chen, J., and Szekely, P. 2004. MAAN: A multi-attribute addressable network for grid information services. J. Grid Comput. 2, 1, 3--14.Google Scholar
Cross Ref
- Costa, P., Napper, J., Pierre, G., and Van Steen, M. 2009. Autonomous resource selection for decentralized utility computing. In Proceedings of the 29th IEEE International Conference on Distributed Computing Systems (ICDCS’09). 561--570. Google Scholar
Digital Library
- Elliott, C. 2009. GENI: Exploring networks of the future. http://www.geni.net.Google Scholar
- George, M. 2006. B-A scale-free network generation and visualization. www.mathworks.com/matlabcentral/fileexchange/11947.Google Scholar
- Germain-Renaud, C., Cady, A., Gauron, P., Jouvin, M., Loomis, C., et al. 2011a. The grid observatory. In Proceedings of the 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID’11). 114--123. Google Scholar
Digital Library
- Germain-Renaud, C., Furst, F., Jouvin, M., Kassel, G., Nauroy, J., and Philippon, G. 2011b. The green computing observatory: A data curation approach for green IT. In Proceedings of the 9th IEEE International Conference on Dependable, Autonomic and Secure Computing (DASC’11). 798--799. Google Scholar
Digital Library
- Heien, E. M., Kondo, D., and Anderson, D. P. 2012. A correlated resource models of Internet end hosts. IEEE Trans. Parallel Distrib. Syst. 23, 6, 977--984. Google Scholar
Digital Library
- Ikeda, S., Kubo, I., and Yamashita, M. 2009. The hitting and cover times of random walks on finite graphs using local degree information. Theor. Comput. Sci. 410, 1, 94--100. Google Scholar
Digital Library
- Iosup, A. and Epema, D. 2010. Grid computing workloads: Bags of tasks, workflows, pilots, and others. IEEE Internet Comput. 15, 2, 19--26. Google Scholar
Digital Library
- Kee, Y. S., Casanova, H., and Chien, A. 2004. Realistic modeling and synthesis of resources for computational grids. In Proceedings of the ACM/IEEE Conference on Supercomputing (SC’04). Google Scholar
Digital Library
- Kim, W., Roopakalu, A., Li, K. Y., and Pai, V. S. 2011. Understanding and characterizing PlanetLab resource usage for federated network testbeds. In Proceedings of the Internet Measurement Conference (IMC’11). Google Scholar
Digital Library
- Lazaro, D., Marques, J. M., Jorba, J., and Vilajosana, X. 2013. Decentralized resource discovery mechanisms for distributed computing in peer-to-peer environments. ACM Comput. Surv. 45, 4. Google Scholar
Digital Library
- Lee, P., Jayasumana, A. P., Bandara, H. M. N. D., Lim, S., and Chandrasekar, V. 2012. A peer-to-peer collaboration framework for multi-sensor data fusion. J. Netw. Comput. Appl. 35, 3, 1052--1066. Google Scholar
Digital Library
- Lu, D. and Dinda, P. A. 2003, Synthesizing realistic computational grids. In Proceedings of the ACM/IEEE Conference on Supercomputing (SC’03). Google Scholar
Digital Library
- Lua, E. K., Crowcroft, J., Pias, M., Sharma, R., and Lim, S. 2004. A survey and comparison of peer-to-peer overlay network schemes. IEEE Comm. Surv. Tutor. 7, 2, 72--93. Google Scholar
Digital Library
- Mclaughlin, D. and Chandrasekar, V. 2009. Short-wavelength technology and the potential for distributed networks of small radar systems. Bull. Amer. Meteorolog. Soc. 90, 1797--1817.Google Scholar
Cross Ref
- Newhouse, S. 2011. European grid infrastructure -- An integrated sustainable Pan-European infrastructure for researchers in Europe (EGI-InSPIRE). Tech. rep. EGI-doc-201-v6. http://go.egi.eu/pdnon.Google Scholar
- Park, K. and Pai, V. S. 2006. CoMon: A mostly-scalable monitoring system for PlanetLab. ACM SIGOPS Oper. Syst. Rev. 40, 1. Google Scholar
Digital Library
- Sahai, A., Singhal, S., Machiraju, V., and Joshi, R. 2004. Automated policy-based resource construction in utility computing environments. In Proceedings of the Network Operations and Management Symposium (NOMS’04). 381--393.Google Scholar
- Shen, H. 2009. A P2P-based intelligent resource discovery mechanism in Internet-based distributed Systems. J. Parallel Distrib. Comput. 69, 197--209. Google Scholar
Digital Library
- Shen, H. and Hwang, K. 2012. Locality-preserving clustering and discovery of resources in wide-area distributed computational grids. IEEE Trans. Comput. 61, 4, 458--473. Google Scholar
Digital Library
- Shen, H., Lin, Y., and Li, T. 2013. Combining efficiency, fidelity and flexibility in resource information services. IEEE Trans. Comput. 64, 2, 353--367.Google Scholar
Digital Library
- Shen, H. and Xu, C.-Z. 2012. Leveraging a compound graph based DHT for multi-attribute range queries with performance analysis. IEEE Trans. Comput. 61, 4, 433--447. Google Scholar
Digital Library
- Stoica, I., Morris, R., Liben-Nowell, D., Karger, D., Kaashoek, M. F., Dabek, F., and Balakrishnan, H. 2003. Chord: A scalable peer-to-peer protocol for Internet applications. IEEE/ACM Trans. Netw. 11, 1, 17--32. Google Scholar
Digital Library
- Sulistio, A., Cibej, U., Venugopal, S., Robic, B., and Buyya, R. 2008. A toolkit for modelling and simulating data grids: An extension to Gridsim. Concurr. Comput. Pract. Exper. 20, 13, 1591--1609. Google Scholar
Digital Library
- Tan, Y., Han, J., and Lu, Y. 2008. Agent-based intelligent resource discovery scheme in P2P networks. In Proceedings of the Pacific-Asia Workshop on Computational Intelligence and Industrial Application (PACIIA’08). 752--756. Google Scholar
Digital Library
Index Terms
P2P-Based, Multi-Attribute Resource Discovery under Real-World Resources and Queries
Recommendations
Resource and query aware, peer-to-peer-based multi-attribute Resource Discovery
LCN '12: Proceedings of the 2012 IEEE 37th Conference on Local Computer Networks (LCN 2012)Distributed, multi-attribute Resource Discovery (RD) is a fundamental requirement in collaborative Peer-to-Peer (P2P), grid, and cloud computing. We present an efficient and load balanced, P2P-based multi-attribute RD solution that consists of five ...
A Cross-Transmission Protocol Architecture Concept for Resource Discovery in P2P Overlay Networks
WCSE '09: Proceedings of the 2009 WRI World Congress on Software Engineering - Volume 03In this paper, we propose a cross-transmission protocol architecture for resource discovery in P2P overlay networks, where each client in the network can query and get the resource identifiers for other P2P overlay networks (like Infohash in Bittorrent ...
A P2P-based intelligent resource discovery mechanism in Internet-based distributed systems
Internet-based distributed systems enable globally-scattered resources to be collectively pooled and used in a cooperative manner to achieve unprecedented petascale supercomputing capabilities. Numerous resource discovery approaches have been proposed ...






Comments