skip to main content
research-article

ALP: Adaptive Loss Protection Scheme with Constant Overhead for Interactive Video Applications

Published:07 January 2015Publication History
Skip Abstract Section

Abstract

There has been an increasing demand for interactive video transmission over the Internet for applications such as video conferencing, video calls, and telepresence applications. These applications are increasingly moving towards providing High Definition (HD) video quality to users. A key challenge in these applications is to preserve the quality of video when it is transported over best-effort networks that do not guarantee lossless transport of video packets. In such conditions, it is important to protect the transmitted video by using intelligent and adaptive protection schemes. Applications such as HD video conferencing require live interaction among participants, which limits the overall delay the system can tolerate. Therefore, the protection scheme should add little or no extra delay to video transport. We propose a novel Adaptive Loss Protection (ALP) scheme for interactive HD video applications such as video conferencing and video chats. This scheme adds negligible delay to the transmission process and is shown to achieve better quality than other schemes in lossy networks. The proposed ALP scheme adaptively applies four different protection modes to cope with the dynamic network conditions, which results in high video quality in all network conditions. Our ALP scheme consists of four protection modes; each of these modes utilizes a protection method. Two of the modes rely on the state-of-the-art protection methods, and we propose a new Integrated Loss Protection (ILP) method for the other two modes. In the ILP method we integrate three factors for distributing the protection among packets. These three factors are error propagation, region of interest and header information. In order to decide when to switch between the protection modes, a new metric is proposed based on the effectiveness of each mode in performing protection, rather than just considering network statistics such as packet loss rate. Results show that by using this metric not only the overall quality will be improved but also the variance of quality will decrease. One of the main advantages of the proposed ALP scheme is that it does not increase the bit rate overhead in poor network conditions. Our results show a significant gain in video quality, up to 3dB PSNR improvement is achieved using our scheme, compared to protecting all packets equally with the same amount of overhead.

Skip Supplemental Material Section

Supplemental Material

References

  1. Andres Albanese, Johannes Blomer, Jeff Edmonds, Michael Luby, and Madhu Sudan. 1996. Priority encoding transmission. IEEE Trans. Inf. Theory 42, 6, 1737--1744. Google ScholarGoogle ScholarCross RefCross Ref
  2. Hemantha Kodikara Arachchi, Warnakulasuriya Anil Chandana Fernando, S. Panchadcharam, and W. A. Rajitha Jayaruwan Weerakkody. 2006. Unequal error protection technique for ROI based H.264 video coding. In Proceedings of the IEEE Canadian Conference on Electrical and Computer Engineering (CCECE'06). 2033--2036.Google ScholarGoogle Scholar
  3. Ali Borji, Dicky N. Sihite, and Laurent Itti. 2012. Salient object detection: A benchmark. In Proceedings of the 12th European Conference on Computer Vision (ECCV'12). Springer, 414--429. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Kiana Calagari, Mohammad Reza Pakravan, and Shervin Shirmohammadi. 2012. ROI-based protection scheme for high definition interactive video applications. In Proceedings of the 20th ACM International Conference on Multimedia (ACM MM'12). ACM, 1033--1036. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Diep Thang Cao, Thuc Hai Nguyen, and Linh Giang Nguyen. 2013. Improving the video transmission quality over IP network. In Proceedings of the 5th International Conference on Ubiquitous and Future Networks (ICUFN'13). IEEE, 570--575.Google ScholarGoogle Scholar
  6. Qian Chen, Li Song, Xiaokang Yang, and Wenjun Zhang. 2007. Robust region-of-interest scalable coding with leaky prediction in H.264/AVC. In Proceedings of the IEEE Workshop on Signal Processing Systems. IEEE, 357--362.Google ScholarGoogle ScholarCross RefCross Ref
  7. Bogdan Ciubotaru, G. Muntean, and George Ghinea. 2009. Objective assessment of region of interest-aware adaptive multimedia streaming quality. IEEE Trans. Broadcasting 55, 2, 202--212.Google ScholarGoogle ScholarCross RefCross Ref
  8. Yves Dhondt, Peter Lambert, and Rik Van de Walle. 2006. A flexible macroblock scheme for unequal error protection. In Proceedings of the IEEE International Conference on Image Processing. IEEE, 829--832.Google ScholarGoogle ScholarCross RefCross Ref
  9. E. O. Elliott. 1963. Estimates of error rates for codes on burst-noise channels. Bell Syst. Tech. J. 42, 5, 1977--1997.Google ScholarGoogle ScholarCross RefCross Ref
  10. Ivan Alen Fernandez, Christophe De Vleeschouwer, George Toma, and Laurent Schumacher. 2012. An interactive video streaming architecture featuring bitrate adaptation. J. Commun. 7, 4, 265--280.Google ScholarGoogle ScholarCross RefCross Ref
  11. Edgar N. Gilbert. 1960. Capacity of a burst-noise channel. Bell Syst. Tech. J. 39, 5, 1253--1265.Google ScholarGoogle ScholarCross RefCross Ref
  12. Bernd Girod, Klaus W. Stuhlmueller, M. Link, and U. Horn. 1998. Packet-loss-resilient Internet video streaming. In Proceedings of SPIE Visual Communications and Image Processing. SPIE, 833--844.Google ScholarGoogle Scholar
  13. Erik Hjelmås and Boon Kee Low. 2001. Face detection: A survey. Comput. Vision Image Understanding 83, 3, 236--274.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Rein-Lien Hsu, Mohamed Abdel-Mottaleb, and Anil K. Jain. 2002. Face detection in color images. IEEE Trans. Pattern Anal. Mach. Intell. 24, 5, 696--706. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Tz-Huan Huang, Kai-Yin Cheng, and Yung-Yu Chuang. 2009. A collaborative benchmark for region of interest detection algorithms. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09). IEEE, 296--303.Google ScholarGoogle ScholarCross RefCross Ref
  16. Abbas Javdtalab, Mona Omidyeganeh, Shervin Shirmohammandi, and Mojtaba Hosseini. 2011. A rate control algorithm for x264 high definition video conferencing. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'11). IEEE, 1--6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Mohammad Kazemi, Shervin Shirmohammadi, and Khosrow Haj Sadeghi. 2014. A review of multiple description coding techniques for error-resilient video delivery. Multimedia Syst. 20, 3, 283--309. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Pei-Jun Lee and Yi-Jie Shih. 2009. Fast inter-frame coding with intra skip strategy in H.264 video coding. IEEE Trans. Consum. Electron. 55, 1, 158--164. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Yihua Lou, Ting Yao, Yongquan Chen, and Wenjun Wu. 2013. A novel scheme of ROI detection and transcoding for mobile devices in high-definition videoconferencing. In Proceedings of the 5th Workshop on Mobile Video (MoVid'13). ACM, 31--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Aditya Mavlankar, David Varodayan, and Bernd Girod. 2007. Region-of-interest prediction for interactively streaming regions of high resolution video. In Proceedings of the 16th International Packet Video Workshop (PV'07). IEEE, 68--77.Google ScholarGoogle ScholarCross RefCross Ref
  21. Gabriel-Miro Muntean, Gheorghita Ghinea, and Timothy Noel Sheehan. 2008. Region of Interest-based adaptive multimedia streaming scheme. IEEE Trans. Broadcasting 54, 2, 296--303.Google ScholarGoogle ScholarCross RefCross Ref
  22. Abdelhamid Nafaa, Tarik Taleb, and Liam Murphy. 2008. Forward error correction strategies for media streaming over wireless networks. IEEE Commun. Mag. 46, 1, 72--79. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Wilfried Osberger and Anthony J. Maeder. 1998. Automatic identification of perceptually important regions in an image. In Proceedings of the 14th International Conference on Pattern Recognition. IEEE, 701--704. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Timothy Porter and Xiao-Hong Peng. 2011. HYBRID TCP/UDP video transport for H.264/AVC content delivery in burst loss networks. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'11). IEEE, 1--5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Horacio Sanson, Alvaro Neira, Luis Loyola, and Mitsuji Matsumoto. 2010. PR-SCTP for real time H.264/AVC video streaming. In Proceedings of the 12th International Conference on Advanced Communication Technology (ICACT'10). IEEE, 59--63. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Wei Song, Dian W. Tjondronegoro, Shu-Hsien Wang, and Michael J. Docherty. 2010. Impact of zooming and enhancing region of interests for optimizing user experience on mobile sports video. In Proceedings of the International Conference on Multimedia (ACM MM'10). ACM, 321--330. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Klaus Stuhlmuller, Niko Farber, Michael Link, and Bernd Girod. 2000. Analysis of video transmission over lossy channels. IEEE J. Selected Areas Commun. 18, 6, 1012--1032. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Hui Su. 2009. Intra-skip in inter-frame coding of H.264/AVC. Int. J. Digital Multimedia Broadcasting.Google ScholarGoogle Scholar
  29. Nikolaos Thomos, Savvas Argyropoulos, Nikolaos V. Boulgouris, and Michael G. Strintzis. 2006. Robust transmission of H.264/AVC video using adaptive slice grouping and unequal error protection. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'06). IEEE, 593--596.Google ScholarGoogle Scholar
  30. Paul Viola and Michael J. Jones. 2004. Robust real-time face detection. Int. J. Computer Vision 57, 2, 137--154. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Xiaolong Wang, Kun Tang, and Huijuan Cui. 2010. A novel unequal error protection scheme for ROI based video coding in H.264/AVC. In Proceedings of the 2nd International Conference on Computer Modeling and Simulation (ICCMS'10). IEEE, 175--178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Yu Wang, Xuan Jing, Jo Yew Tham, Kwong Huang Goh, and Wei Siong Lee. 2011. Error-resilient slice interleaving for robust video transmission over bursty loss channels. In Proceedings of the 17th IEEE International Conference on Networks (ICON'11). IEEE, 41--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Yao Wang and Qin-Fan Zhu. 1998. Error control and concealment for video communication: A review. Proc. IEEE 86, 5, 974--997.Google ScholarGoogle ScholarCross RefCross Ref
  34. Stephan Wenger. 2003. H.264/AVC over IP. IEEE Trans. Circuits Syst. Video Technol. 13, 7, 645--656. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Thomas Wiegand, Gary J. Sullivan, Gisle Bjontegaard, and Ajay Luthra. 2003. Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol. 13, 7, 560--576. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Dapeng Wu, Yiwei Thomas Hou, and Ya-Qin Zhang. 2000. Transporting real-time video over the Internet: Challenges and approaches. Proc. IEEE 88, 12, 1855--1877.Google ScholarGoogle ScholarCross RefCross Ref
  37. Yi-Fei Xu and Hai-Bo Hu. 2013. Development of a network adaptive H.264/AVC medical video transmission system. Int. J. Future Computer Commun. 2, 4, 292--295.Google ScholarGoogle ScholarCross RefCross Ref
  38. Cha Zhang and Zhengyou Zhang. 2010. A survey of recent advances in face detection. Tech. Rep. MSR-TR-2010-66. Microsoft Research Technical Report, Redmond, WA.Google ScholarGoogle Scholar
  39. Xingjun Zhang and Xiaohong Peng. 2009. An unequal packet loss protection scheme for H.264/AVC video transmission. In Proceedings of the 23rd International Conference on Information Networking (ICOIN'09). IEEE, 195--199. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Xingjun Zhang, Xiaohong Peng, Scott Fowler, and Dajun Wu. 2010. Robust H.264/AVC video transmission using data partitioning and unequal loss protection. In Proceedings of the 10th IEEE International Conference on Computer and Information Technology (CIT'10). IEEE, 2471--2477. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Xingjun Zhang, Xiaohong Peng, Dajun Wu, Tim Porter, and Richard Haywood. 2009. A hierarchical unequal packet loss protection scheme for robust H.264/AVC transmission. In Proceedings of the 6th IEEE Consumer Communications and Networking Conference (CCNC'09). IEEE, 1--5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Yanchun Zhong, Heng Li, and Jialei Bi. 2010. A feedback-based method for adaptive ROI protection in H.264/AVC. In Proceedings of the 5th International Conference on Digital Information Management (ICDIM'10). 145--151.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. ALP: Adaptive Loss Protection Scheme with Constant Overhead for Interactive Video Applications

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!