Abstract
The last five years have witnessed an explosion of networked video sharing, represented by YouTube, as a new killer Internet application. Their sustainable development however is severely hindered by the intrinsic limit of their client/server architecture. A shift to the peer-to-peer paradigm has been widely suggested with success already shown in live video streaming and movie-on-demand. Unfortunately, our latest measurement demonstrates that short video clips exhibit drastically different statistics, which would simply render these existing solutions suboptimal, if not entirely inapplicable.
Our long-term measurement over five million YouTube videos, on the other hand, reveals interesting social networks with strong correlation among the videos, thus opening new opportunities to explore. In this article, we present NetTube, a novel peer-to-peer assisted delivering framework that explores the user interest correlation for short video sharing. We address a series of key design issues to realize the system, including a bi-layer overlay, an efficient indexing scheme, a delay-aware scheduling mechanism, and a prefetching strategy leveraging interest correlation. We evaluate NetTube through both simulations and prototype experiments, which show that it greatly reduces the server workload, improves the playback quality and scales well.
- Aggarwal, V., Caldebank, R., Gopalakrishnan, V., Jana, R., Ramakrishnan, K., and Yu, F. 2009. The effectiveness of intelligent scheduling for multicast video-on-demand. In Proceedings of the 17th ACM International Conference on Multimedia (MM). ACM, New York, NY, 421--430. Google Scholar
Digital Library
- Albert, R., Jeong, H., and Barabási, A.-L. 1999. The diameter of the World Wide Web. Nature 401, 130--131.Google Scholar
Cross Ref
- Alexa. 2010. Youtube.com site info. http://www.alexa.com/siteinfo/youtube.com.Google Scholar
- Benevenuto, F., Rodrigues, T., Cha, M., and Almeida, V. 2009. Characterizing user behavior in online social networks. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 49--62. Google Scholar
Digital Library
- Blog, O. Y. 2009. Zoinks! 20 hours of video uploaded every minute! http://youtube-global.blogspot.com/2009/05/zoinks-20-hours-of-video-uploaded-every_20.html.Google Scholar
- Bloom, B. 1970. Space/time trade-offs in hash coding with allowable errors. Comm. ACM 13, 7, 422--426. Google Scholar
Digital Library
- Carter, L. 2008. Web could collapse as video demand soars. http://www.telegraph.co.uk/news/uknews/1584230/Web-could-collapse-as-video -demand-soars.html.Google Scholar
- Cha, M., Kwak, H., Rodriguez, P., Ahn, Y.-Y., and Moon, S. 2007. I tube, you tube, everybody tubes: Analyzing the world's largest user generated content video system. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 1--14. Google Scholar
Digital Library
- Cha, M., Rodriguez, P., Crowcroft, J., Moon, S., and Amatriain, X. 2008. Watching television over an IP network. In Proceedings of the 8th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 71--84. Google Scholar
Digital Library
- Cheng, X., Dale, C., and Liu, J. 2008. Statistics and social network of YouTube videos. In Proceedings of the 16th International Workshop on Quality of Service (IWQoS). IEEE, Los Alamitos, CA, 229--238.Google Scholar
- Cheng, X. and Liu, J. 2009. NetTube: Exploring social networks for peer-to-peer short video sharing. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 1152--1160.Google Scholar
- Cheng, X., Liu, J., and Dale, C. 2010. Understanding the characteristics of internet short video sharing: A YouTube-based measurement study. IEEE Trans. Multimedia.Google Scholar
- Corbett, C. 2006. Peering of video. http://www.nanog.org/mtg-0606/pdf/bill.norton.3.pdf.Google Scholar
- Gill, P., Arlitt, M., Li, Z., and Mahanti, A. 2007. YouTube traffic characterization: A view from the edge. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 15--28. Google Scholar
Digital Library
- Gopalakrishnan, V., Bhattacharjeey, B., Ramakrishnan, K., Jana, R., and Srivastava, D. 2009. CPM: Adaptive video-on-demand with cooperative peer assists and multicast. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 91--99.Google Scholar
- Huang, C., Li, J., and Ross, K. 2007. Can internet video-on-demand be profitable? In Proceedings of ACM SIGCOMM. ACM, New York, NY, 133--144. Google Scholar
Digital Library
- Huang, Y., Fu, T. Z., Chiu, D.-M., Lui, J. C., and Huang, C. 2008. Challenges, design and analysis of a large-scale P2P-VoD system. In Proceedings of the ACM SIGCOMM. ACM, New York, NY, 375--388. Google Scholar
Digital Library
- La Monica, P. R. 2006. Google to buy YouTube for $1.65 billion. http://money.cnn.com/2006/10/09/technology/googleyoutube_deal.Google Scholar
- Lai, K. and Wang, D. 2010. The implication of external links on video sharing sites: Measurement and analysis. In Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY. Google Scholar
Digital Library
- Liang, C., Guo, Y., and Liu, Y. 2009. Investigating the scheduling sensitivity of P2P video streaming: An experimental study. IEEE Trans. Multimedia 11, 3, 348--360. Google Scholar
Digital Library
- Liu, J., Rao, S. G., Li, B., and Zhang, H. 2008. Opportunities and challenges of peer-to-peer Internet Video Broadcast. Proc. IEEE 96, 1, 11--24.Google Scholar
Cross Ref
- Liu, Z., Wu, C., Li, B., and Zhao, S. 2009. Distilling superior peers in large-scale P2P streaming systems. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 82--90.Google Scholar
- Magharei, N. and Rejaie, R. 2009a. Overlay monitoring and repair in swarm-based peer-to-peer streaming. In Proceedings of the 19th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY, 25--30. Google Scholar
Digital Library
- Magharei, N. and Rejaie, R. 2009b. PRIME: Peer-to-peer receiver-driven mesh-based streaming. IEEE/ACM Trans. Netw. 17, 4, 1052--1065. Google Scholar
Digital Library
- Mislove, A., Marcon, M., Gummadi, K., Dreschel, P., and Bhattacharjee, B. 2007. Measurement and analysis of online social networks. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 29--42. Google Scholar
Digital Library
- O'Reilly, T. 2005. What Is Web 2.0: Design patterns and business models for the next generation of software. http://www.oreilly.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20.html.Google Scholar
- Qiu, X., Wu, C., Lin, X., and Lau, F. C. 2009. InstantLeap: Fast neighbor discovery in P2P VoD streaming. In Proceedings of the 19th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY, 19--24. Google Scholar
Digital Library
- Rao, L. 2010. comScore: YouTube reaches all-time high of 14.6 billion videos viewed in May. http://techcrunch.com/2010/06/24/comscore-youtube-reaches-all-time-high-of-14-6-billion-videos-viewed-in-may.Google Scholar
- Saxena, M., Sharan, U., and Fahmy, S. 2008. Analyzing video services in Web 2.0: A global perspective. In Proceedings of the 18th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY, 39--44. Google Scholar
Digital Library
- Schneider, F., Feldmann, A., Krishnamurthy, B., and Willinger, W. 2009. Understanding Online Social Network Usage from a Network Perspective. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 35--48. Google Scholar
Digital Library
- Song, H. H., Cho, T. W., Dave, V., Zhang, Y., and Qiu, L. 2009. Scalable Proximity Estimation and Link Prediction in Online Social Networks. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 322--335. Google Scholar
Digital Library
- Venkataraman, V., Yoshida, K., and Francis, P. 2006. Chunkyspread: Heterogeneous unstructured tree-based peer-to-peer multicast. In Proceedings of the 14th IEEE International Conference on Network Protocols (ICNP). IEEE, Los Alamitos, CA, 2--11. Google Scholar
Digital Library
- Wang, F., Liu, J., and Xiong, Y. 2008. Stable peers: Existence, importance, and application in peer-to-peer live video streaming. In Proceedings of the 27th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 1364--1372.Google Scholar
- Watts, D. 1999. Small Worlds: the Dynamics of Networks Between Order and Randomness. Princeton University Press, Princeton, NJ. Google Scholar
Digital Library
- Wu, C., Li, B., and Zhao, S. 2008. Multi-channel live P2P streaming: Refocusing on servers. In Proceedings of the 27th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 1355--1363.Google Scholar
- Wu, D., Liang, C., Liu, Y., and Ross, K. 2009. View-upload decoupling: A redesign of multi-channel P2P video systems. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 2726--2730.Google Scholar
- Yen, Y.-W. 2008. YouTube looks for the money clip. http://techland.blogs.fortune.cnn.com/2008/03/25/youtube-looks-for-the-money-clip.Google Scholar
- Yin, H., Liu, X., Qiu, F., Xia, N., Lin, C., Zhang, H., Sekar, V., and Min, G. 2009. Inside the bird's Nest: Measurements of large-scale live VoD from the 2008 Olympics. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 442--455. Google Scholar
Digital Library
- Zhang, X., Liu, J., Li, B., and Yum, T.-S. P. 2005. CoolStreaming/DONet: A data-driven overlay network for peer-to-peer live media streaming. In Proceedings of the 24th IEEE Conference on Computer Communications (INFOCOM). Vol. 3. IEEE, Los Alamitos, CA, NJ, 2102--2111.Google Scholar
Index Terms
Exploring interest correlation for peer-to-peer socialized video sharing
Recommendations
Peer-to-peer delivery system for short video sharing
SpringSim '10: Proceedings of the 2010 Spring Simulation MulticonferencePeer-to-peer streaming applications are recently emerged successes that are able to serve users adequately on large scales. Recently, multimedia streaming of the user generated media content has been highly demanded for instance on YouTube. P2P systems ...
Peer Interest-based Discovery for Decentralized Peer-to-Peer Systems
3PGCIC '10: Proceedings of the 2010 International Conference on P2P, Parallel, Grid, Cloud and Internet ComputingThe success of content distribution oriented peer-to-peer systems heavily depends on the resource discovery mechanism. In case of large-scale distributed systems, this mechanism must be scalable and robust. The paper proposes a structured solution for ...
Indexing through Querying in Unstructured Peer-to-Peer Overlay Networks
APNOMS '08: Proceedings of the 11th Asia-Pacific Symposium on Network Operations and Management: Challenges for Next Generation Network Operations and Service ManagementThe efficiency of a Peer-to-Peer file sharing overlay is measured in terms of the scalability and versatility of its object lookup strategy. In these networks peers carry out distributed query relaying to discover the service providers. Existing lookup ...






Comments