skip to main content
research-article

Fast min-hashing indexing and robust spatio-temporal matching for detecting video copies

Authors Info & Claims
Published:23 March 2010Publication History
Skip Abstract Section

Abstract

The increase in the number of video copies, both legal and illegal, has become a major problem in the multimedia and Internet era. In this article, we propose a novel method for detecting various video copies in a video sequence. To achieve fast and robust detection, the method fully integrates several components, namely the min-hashing signature to compactly represent a video sequence, a spatio-temporal matching scheme to accurately evaluate video similarity compiled from the spatial and temporal aspects, and some speedup techniques to expedite both min-hashing indexing and spatio-temporal matching. The results of experiments demonstrate that, compared to several baseline methods with different feature descriptors and matching schemes, the proposed method which combines both global and local feature descriptors yields the best performance when encountering a variety of video transformations. The method is very fast, requiring approximately 0.06 seconds to search for copies of a thirty-second video clip in a six-hour video sequence.

References

  1. Andoni, A. and Indyk, P. 2008. Near-optimal hashing algorithms for approximate nearest neighbor in high dimension. Comm. ACM 51, 1, 117--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Buhler, J. 2001. Efficient large-scale sequence comparison by locality-sensitive hashing. Bioinform. 17, 5, 419--218.Google ScholarGoogle ScholarCross RefCross Ref
  3. Chang, S. F., Chen, W., Meng, H. J., Sundaram, H., and Zhong, D. 1998. A fully automated content-based video search engine supporting spatiotemporal queries. IEEE Trans. Circuits Syst. Video Technol. 8, 5, 602--615. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Cheung, S. C. and Zakhor, A. 2003. Efficient video similarity measurement with video signature. IEEE Trans. Circuits Syst. Video Technol. 13, 1, 59--74. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Chiu, C. Y., Yang, C. C., and Chen, C. S. 2007. Efficient and effective video copy detection based on spatiotemporal analysis. In Proceedings of the IEEE International Symposium on Multimedia (ISM). 10--12, 202--209. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Chiu, C. Y., Chen, C. S., and Chien, L. F. 2008. A framework for handling spatiotemporal variations in video copy detection. IEEE Trans. Circuits Syst. Video Technol. 18, 3, 412--417. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Cohen, E., Datar, M., Fujiwara, S., Gionis, A., Indyk, P., Motwani, R., Ullman, J., and Yang, C. 2000. Finding interesting associations without support pruning. In Proceedings of the IEEE International Conference on Data Engineering (ICDE). 489--500. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Das, A., Datar, M., and Garg, A. 2007. Google news personalization: scalable online collaborative filtering. In Proceedings of International World Wide Web Conference (WWW). Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Dementhon, D. and Doermann, D. 2006. Video retrieval of near-duplicates using k-nearest neighbor retrieval of spatio-temporal descriptors. Multimedia Tools Appl. 30, 3, 229--253. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Deng, Y. and Manjunath, B. S. 1998. NeTra-V: toward an object-based video representation. IEEE Trans. Circuits Syst. Video Technol. 8, 5, 616--627. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Ennesser, F. and Medioni, G. 1995. Finding Waldo, or focus of attention using local color information. IEEE Trans. Patt. Anal. Mach. Intell. 17, 8, 805--809. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Hampapur, A. and Bolle, R. M. 2001. Comparison of distance measures for video copy detection. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME). 737--740.Google ScholarGoogle Scholar
  13. Hoad, T. C. and Zobel, J. 2006. Detection of video sequence using compact signatures. ACM Trans. Inform. Syst. 24, 1, 1--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hua, X. S., Chen, X., and Zhang, H. J. 2004. Robust video signature based on ordinal measure. In Proceedings of the IEEE International Conference on Image Processing (ICIP). Volume 1, 685--688.Google ScholarGoogle Scholar
  15. Jain, A. K., Vailaya, A., and Xiong, W. 1999. Query by video clip. Multimedia Syst. 7, 5, 369--384. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Joly, A., Buisson, O., and Frelicot, C. 2007. Content-based copy retrieval using distortion-based probabilistic similarity search. IEEE Trans. Multimedia 9, 2, 293--306. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Kashino, K., Kurozumi, T., and Murase, H. 2003. A quick search method for audio and video signals based on histogram pruning. IEEE Trans. Multimedia 5, 3, 348--357. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Ke, Y., Sukthankar, R., and Huston, L. 2004. An efficient parts-based near-duplicate and sub-image retrieval system. In Proceedings of the ACM International Conference on Multimedia (MM). 869--876. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Kim, C. and Vasudev, B. 2005. Spatiotemporal sequence matching for efficient video copy detection. IEEE Trans. Circuits Syst. Video Technol. 15, 1, 127--132. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Kim, H. S., Lee, J., Liu, H., and Lee, D. 2008. Video linkage: group based copied video detection. In Proceedings of the ACM International Conference on Content-based Image and Video Retrieval (CIVR). 397--406. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Law-To, J., Buisson, O., Gouet-Brunet, V., and Boujemaa, N. 2006. Robust voting algorithm based on labels of behavior for video copy detection. In Proceedings of the ACM International Conference on Multimedia (MM). 835--844. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Law-To, J., Chen, L., Joly, A., Laptev, I., Buission, O., Gouet-Brunet, V., Boujemaa, N., and Stentiford, F. 2007. Video copy detection: a comparative study. In Proceedings of the ACM International Conference on Image and Video Retrieval (CIVR). 371--378. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Liu, T., Zhang, H. J., and Qi, F. 2003. A novel video key-frame extraction algorithm based on perceived motion energy model. IEEE Trans. Circuits Syst. Video Technol. 13, 10, 1006--1013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Lowe, D. G. Distinctive image features from scale-invariant keypoints. 2004. Inter. J. Comput. Vision 60, 2, 91--110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Massoudi, A., Lefebvre, F., Demarty, C. H., Oisel, L., and Chupeau, B. 2006. A video fingerprint based on visual digest and local fingerprints. In Proceedings of the IEEE International Conference on Image Processing (ICIP). 2297--2300.Google ScholarGoogle Scholar
  26. Naphade, M. R. and Huang, T. S. 2001. A probabilistic framework for semantic video indexing, filtering, and retrieval. IEEE Trans. Multimedia 3, 1, 141--151. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Poullot, S., Crucianu, M., and Buisson, O. 2008. Scalable mining of large video databases using copy detection. In Proceedings of the ACM International Conference on Multimedia (MM). 61--70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Sayood, K. 1996. Introduction to Data Compression, Morgan Kaufmann, Los Altos, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Schmid, C. and Mohr, R. 1997. Local grayvalue invariants for image retrieval. IEEE Trans. Patt. Anal. Mach. Intell. 19, 5, 530--535. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Shen, H. T., Ooi, B. C., Zhou, X., and Huang, Z. 2005. Towards effective indexing for very large video sequence database. In Proceedings of the ACM International Conference on Management of Data (SIGMOD). 730--741. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Smoliar, S. W. and Zhang, H. 1994. Content-based video indexing and retrieval. IEEE Multimedia 1, 2, 62--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Sonka, M., Hlavac, V., and Boyle, R. 1999. Image Processing, Analysis, and Machine Vision, Brooks/Cole Publishing, Pacific Grove, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Swain, M. J. and Ballard, D. H. 1991. Color indexing. Int. J. Comput. Vision 7. 1, 11--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Willems, G., Tuytelaars, T., and Gool, L. V. 2008. Spatio-temporal features for robust content-based video copy detection. In Proceedings of the ACM International Conference on Multimedia Information Retrieval. 283--290. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Wu, X., Hauptmann, A. G., and Ngo, C. W. 2007. Practical elimination of near-duplicates from Web video search. In Proceedings of the ACM International Conference on Multimedia (MM). 218--227. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Yuan, J., Duan, L. Y., Tian, Q., and Xu, C. 2004. Fast and robust search short video clip search using an index structure. In Proceedings of the ACM International Workshop on Multimedia Information Retrieval (MIR). 61--68. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Fast min-hashing indexing and robust spatio-temporal matching for detecting video copies

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Transactions on Multimedia Computing, Communications, and Applications
            ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 6, Issue 2
            March 2010
            119 pages
            ISSN:1551-6857
            EISSN:1551-6865
            DOI:10.1145/1671962
            Issue’s Table of Contents

            Copyright © 2010 ACM

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 23 March 2010
            • Revised: 1 January 2009
            • Accepted: 1 January 2009
            • Received: 1 May 2008
            Published in tomm Volume 6, Issue 2

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!