Abstract
There has been an increasing demand for interactive video transmission over the Internet for applications such as video conferencing, video calls, and telepresence applications. These applications are increasingly moving towards providing High Definition (HD) video quality to users. A key challenge in these applications is to preserve the quality of video when it is transported over best-effort networks that do not guarantee lossless transport of video packets. In such conditions, it is important to protect the transmitted video by using intelligent and adaptive protection schemes. Applications such as HD video conferencing require live interaction among participants, which limits the overall delay the system can tolerate. Therefore, the protection scheme should add little or no extra delay to video transport. We propose a novel Adaptive Loss Protection (ALP) scheme for interactive HD video applications such as video conferencing and video chats. This scheme adds negligible delay to the transmission process and is shown to achieve better quality than other schemes in lossy networks. The proposed ALP scheme adaptively applies four different protection modes to cope with the dynamic network conditions, which results in high video quality in all network conditions. Our ALP scheme consists of four protection modes; each of these modes utilizes a protection method. Two of the modes rely on the state-of-the-art protection methods, and we propose a new Integrated Loss Protection (ILP) method for the other two modes. In the ILP method we integrate three factors for distributing the protection among packets. These three factors are error propagation, region of interest and header information. In order to decide when to switch between the protection modes, a new metric is proposed based on the effectiveness of each mode in performing protection, rather than just considering network statistics such as packet loss rate. Results show that by using this metric not only the overall quality will be improved but also the variance of quality will decrease. One of the main advantages of the proposed ALP scheme is that it does not increase the bit rate overhead in poor network conditions. Our results show a significant gain in video quality, up to 3dB PSNR improvement is achieved using our scheme, compared to protecting all packets equally with the same amount of overhead.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, ALP: Adaptive Loss Protection Scheme with Constant Overhead for Interactive Video Applications
- Andres Albanese, Johannes Blomer, Jeff Edmonds, Michael Luby, and Madhu Sudan. 1996. Priority encoding transmission. IEEE Trans. Inf. Theory 42, 6, 1737--1744. Google Scholar
Cross Ref
- Hemantha Kodikara Arachchi, Warnakulasuriya Anil Chandana Fernando, S. Panchadcharam, and W. A. Rajitha Jayaruwan Weerakkody. 2006. Unequal error protection technique for ROI based H.264 video coding. In Proceedings of the IEEE Canadian Conference on Electrical and Computer Engineering (CCECE'06). 2033--2036.Google Scholar
- Ali Borji, Dicky N. Sihite, and Laurent Itti. 2012. Salient object detection: A benchmark. In Proceedings of the 12th European Conference on Computer Vision (ECCV'12). Springer, 414--429. Google Scholar
Digital Library
- Kiana Calagari, Mohammad Reza Pakravan, and Shervin Shirmohammadi. 2012. ROI-based protection scheme for high definition interactive video applications. In Proceedings of the 20th ACM International Conference on Multimedia (ACM MM'12). ACM, 1033--1036. Google Scholar
Digital Library
- Diep Thang Cao, Thuc Hai Nguyen, and Linh Giang Nguyen. 2013. Improving the video transmission quality over IP network. In Proceedings of the 5th International Conference on Ubiquitous and Future Networks (ICUFN'13). IEEE, 570--575.Google Scholar
- Qian Chen, Li Song, Xiaokang Yang, and Wenjun Zhang. 2007. Robust region-of-interest scalable coding with leaky prediction in H.264/AVC. In Proceedings of the IEEE Workshop on Signal Processing Systems. IEEE, 357--362.Google Scholar
Cross Ref
- Bogdan Ciubotaru, G. Muntean, and George Ghinea. 2009. Objective assessment of region of interest-aware adaptive multimedia streaming quality. IEEE Trans. Broadcasting 55, 2, 202--212.Google Scholar
Cross Ref
- Yves Dhondt, Peter Lambert, and Rik Van de Walle. 2006. A flexible macroblock scheme for unequal error protection. In Proceedings of the IEEE International Conference on Image Processing. IEEE, 829--832.Google Scholar
Cross Ref
- E. O. Elliott. 1963. Estimates of error rates for codes on burst-noise channels. Bell Syst. Tech. J. 42, 5, 1977--1997.Google Scholar
Cross Ref
- Ivan Alen Fernandez, Christophe De Vleeschouwer, George Toma, and Laurent Schumacher. 2012. An interactive video streaming architecture featuring bitrate adaptation. J. Commun. 7, 4, 265--280.Google Scholar
Cross Ref
- Edgar N. Gilbert. 1960. Capacity of a burst-noise channel. Bell Syst. Tech. J. 39, 5, 1253--1265.Google Scholar
Cross Ref
- Bernd Girod, Klaus W. Stuhlmueller, M. Link, and U. Horn. 1998. Packet-loss-resilient Internet video streaming. In Proceedings of SPIE Visual Communications and Image Processing. SPIE, 833--844.Google Scholar
- Erik Hjelmås and Boon Kee Low. 2001. Face detection: A survey. Comput. Vision Image Understanding 83, 3, 236--274.Google Scholar
Digital Library
- Rein-Lien Hsu, Mohamed Abdel-Mottaleb, and Anil K. Jain. 2002. Face detection in color images. IEEE Trans. Pattern Anal. Mach. Intell. 24, 5, 696--706. Google Scholar
Digital Library
- Tz-Huan Huang, Kai-Yin Cheng, and Yung-Yu Chuang. 2009. A collaborative benchmark for region of interest detection algorithms. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09). IEEE, 296--303.Google Scholar
Cross Ref
- Abbas Javdtalab, Mona Omidyeganeh, Shervin Shirmohammandi, and Mojtaba Hosseini. 2011. A rate control algorithm for x264 high definition video conferencing. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'11). IEEE, 1--6. Google Scholar
Digital Library
- Mohammad Kazemi, Shervin Shirmohammadi, and Khosrow Haj Sadeghi. 2014. A review of multiple description coding techniques for error-resilient video delivery. Multimedia Syst. 20, 3, 283--309. Google Scholar
Digital Library
- Pei-Jun Lee and Yi-Jie Shih. 2009. Fast inter-frame coding with intra skip strategy in H.264 video coding. IEEE Trans. Consum. Electron. 55, 1, 158--164. Google Scholar
Digital Library
- Yihua Lou, Ting Yao, Yongquan Chen, and Wenjun Wu. 2013. A novel scheme of ROI detection and transcoding for mobile devices in high-definition videoconferencing. In Proceedings of the 5th Workshop on Mobile Video (MoVid'13). ACM, 31--36. Google Scholar
Digital Library
- Aditya Mavlankar, David Varodayan, and Bernd Girod. 2007. Region-of-interest prediction for interactively streaming regions of high resolution video. In Proceedings of the 16th International Packet Video Workshop (PV'07). IEEE, 68--77.Google Scholar
Cross Ref
- Gabriel-Miro Muntean, Gheorghita Ghinea, and Timothy Noel Sheehan. 2008. Region of Interest-based adaptive multimedia streaming scheme. IEEE Trans. Broadcasting 54, 2, 296--303.Google Scholar
Cross Ref
- Abdelhamid Nafaa, Tarik Taleb, and Liam Murphy. 2008. Forward error correction strategies for media streaming over wireless networks. IEEE Commun. Mag. 46, 1, 72--79. Google Scholar
Digital Library
- Wilfried Osberger and Anthony J. Maeder. 1998. Automatic identification of perceptually important regions in an image. In Proceedings of the 14th International Conference on Pattern Recognition. IEEE, 701--704. Google Scholar
Digital Library
- Timothy Porter and Xiao-Hong Peng. 2011. HYBRID TCP/UDP video transport for H.264/AVC content delivery in burst loss networks. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'11). IEEE, 1--5. Google Scholar
Digital Library
- Horacio Sanson, Alvaro Neira, Luis Loyola, and Mitsuji Matsumoto. 2010. PR-SCTP for real time H.264/AVC video streaming. In Proceedings of the 12th International Conference on Advanced Communication Technology (ICACT'10). IEEE, 59--63. Google Scholar
Digital Library
- Wei Song, Dian W. Tjondronegoro, Shu-Hsien Wang, and Michael J. Docherty. 2010. Impact of zooming and enhancing region of interests for optimizing user experience on mobile sports video. In Proceedings of the International Conference on Multimedia (ACM MM'10). ACM, 321--330. Google Scholar
Digital Library
- Klaus Stuhlmuller, Niko Farber, Michael Link, and Bernd Girod. 2000. Analysis of video transmission over lossy channels. IEEE J. Selected Areas Commun. 18, 6, 1012--1032. Google Scholar
Digital Library
- Hui Su. 2009. Intra-skip in inter-frame coding of H.264/AVC. Int. J. Digital Multimedia Broadcasting.Google Scholar
- Nikolaos Thomos, Savvas Argyropoulos, Nikolaos V. Boulgouris, and Michael G. Strintzis. 2006. Robust transmission of H.264/AVC video using adaptive slice grouping and unequal error protection. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'06). IEEE, 593--596.Google Scholar
- Paul Viola and Michael J. Jones. 2004. Robust real-time face detection. Int. J. Computer Vision 57, 2, 137--154. Google Scholar
Digital Library
- Xiaolong Wang, Kun Tang, and Huijuan Cui. 2010. A novel unequal error protection scheme for ROI based video coding in H.264/AVC. In Proceedings of the 2nd International Conference on Computer Modeling and Simulation (ICCMS'10). IEEE, 175--178. Google Scholar
Digital Library
- Yu Wang, Xuan Jing, Jo Yew Tham, Kwong Huang Goh, and Wei Siong Lee. 2011. Error-resilient slice interleaving for robust video transmission over bursty loss channels. In Proceedings of the 17th IEEE International Conference on Networks (ICON'11). IEEE, 41--46. Google Scholar
Digital Library
- Yao Wang and Qin-Fan Zhu. 1998. Error control and concealment for video communication: A review. Proc. IEEE 86, 5, 974--997.Google Scholar
Cross Ref
- Stephan Wenger. 2003. H.264/AVC over IP. IEEE Trans. Circuits Syst. Video Technol. 13, 7, 645--656. Google Scholar
Digital Library
- Thomas Wiegand, Gary J. Sullivan, Gisle Bjontegaard, and Ajay Luthra. 2003. Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol. 13, 7, 560--576. Google Scholar
Digital Library
- Dapeng Wu, Yiwei Thomas Hou, and Ya-Qin Zhang. 2000. Transporting real-time video over the Internet: Challenges and approaches. Proc. IEEE 88, 12, 1855--1877.Google Scholar
Cross Ref
- Yi-Fei Xu and Hai-Bo Hu. 2013. Development of a network adaptive H.264/AVC medical video transmission system. Int. J. Future Computer Commun. 2, 4, 292--295.Google Scholar
Cross Ref
- Cha Zhang and Zhengyou Zhang. 2010. A survey of recent advances in face detection. Tech. Rep. MSR-TR-2010-66. Microsoft Research Technical Report, Redmond, WA.Google Scholar
- Xingjun Zhang and Xiaohong Peng. 2009. An unequal packet loss protection scheme for H.264/AVC video transmission. In Proceedings of the 23rd International Conference on Information Networking (ICOIN'09). IEEE, 195--199. Google Scholar
Digital Library
- Xingjun Zhang, Xiaohong Peng, Scott Fowler, and Dajun Wu. 2010. Robust H.264/AVC video transmission using data partitioning and unequal loss protection. In Proceedings of the 10th IEEE International Conference on Computer and Information Technology (CIT'10). IEEE, 2471--2477. Google Scholar
Digital Library
- Xingjun Zhang, Xiaohong Peng, Dajun Wu, Tim Porter, and Richard Haywood. 2009. A hierarchical unequal packet loss protection scheme for robust H.264/AVC transmission. In Proceedings of the 6th IEEE Consumer Communications and Networking Conference (CCNC'09). IEEE, 1--5. Google Scholar
Digital Library
- Yanchun Zhong, Heng Li, and Jialei Bi. 2010. A feedback-based method for adaptive ROI protection in H.264/AVC. In Proceedings of the 5th International Conference on Digital Information Management (ICDIM'10). 145--151.Google Scholar
Cross Ref
Index Terms
ALP: Adaptive Loss Protection Scheme with Constant Overhead for Interactive Video Applications
Recommendations
ROI-based protection scheme for high definition interactive video applications
MM '12: Proceedings of the 20th ACM international conference on MultimediaIn this work, first, a Region of Interest (ROI)-based Unequal Loss Protection (ULP) scheme with no delay is proposed for High Definition (HD) interactive video applications such as video calls. The proposed scheme uses Data Partitioning and Flexible ...
Analysis of Packet Loss for Compressed Video: Effect of Burst Losses and Correlation Between Error Frames
Video communication is often afflicted by various forms of losses, such as packet loss over the Internet. This paper examines the question of whether the packet loss pattern, and in particular, the burst length, is important for accurately estimating ...
Performance Improvement in Broadband Networks Using Forward Error Correction for Lost Packet Recovery
In this paper we analyze and provide simulation results for the use of forward error control (FEC) to improve the delay-throughput performance of packetized high-speed networks. The major source of errors in high-speed networks is expected to be buffer ...






Comments