skip to main content
10.1145/511446.511454acmconferencesArticle/Chapter ViewAbstractPublication PageswwwConference Proceedingsconference-collections
Article

OCTOPUS: aggressive search of multi-modality data using multifaceted knowledge base

Authors Info & Claims
Published:07 May 2002Publication History

ABSTRACT

An important trend in Web information processing is the support of multimedia retrieval. However, the most prevailing paradigm for multimedia retrieval, content-based retrieval (CBR), is a rather conservative one whose performance depends on a set of specifically defined low-level features and a carefully chosen sample object. In this paper, an aggressive search mechanism called Octopus is proposed which addresses the retrieval of multi-modality data using multifaceted knowledge. In particular, Octopus promotes a novel scenario in which the user supplies seed objects of arbitrary modality as the hint of his information need, and receives a set of multi-modality objects satisfying his need. The foundation of Octopus is a multifaceted knowledge base constructed on a layered graph model (LGM), which describes the relevance between media objects from various perspectives. Link analysis based retrieval algorithm is proposed based on the LGM. A unique relevance feedback technique is developed to update the knowledge base by learning from user behaviors, and to enhance the retrieval performance in a progressive manner. A prototype implementing the proposed approach has been developed to demonstrate its feasibility and capability through illustrative examples.

References

  1. Benitez, A. B., Smith, J. R. and Chang, S. F. "MediaNet: A Multimedia Information Network for Knowledge Representation". In Proc. of the SPIE 2000 Conference on Internet Multimedia Management Systems, vol.4210, 2000.Google ScholarGoogle Scholar
  2. Bharat, K. and Henzinger, M. R., "Improved Algorithm for Topic Distilling in Hyperlinked Environments". In Proc. of the 21st Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 104--111, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Brin, S. and Page, L., "The Anatomy of a Large-Scale Hypertextual Web Search Engine." In Proc. of the 7th Int. World Wide Web Conf, pp. 107--117, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Chang, S. F., Chen, W., Meng, H. J., Sundaram, H. and Zhong, D., "VideoQ: An Automated Content Based Video Search System Using Visual Cues". In Proc. of ACM Multimedia, pp. 313--324, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Chen, W. and Chang, S. F. "VISMAP: An Interactive Image/Video Retrieval System Using Visualization and Concept Maps", In Proc. of Int. Conf. on Image Processing (ICIP), Greece, October 2001.Google ScholarGoogle ScholarCross RefCross Ref
  6. Dean, J. and Henzinger, M. R., "Finding Related Pages on the Web." In Proc. of the 8th Int. World Wide Web Conf. pp. 389--401, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Flickner, M., Sawhney, H., Niblack, W. and Ashley, J., "Query by image and video content: The QBIC system." IEEE Computer, pp. 23--32, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Gibson, D., Kleinberg, J. M., and Paghavan, P., "Inferring Web Communities from Link Topology." In Proc. of the 9th Conf. on Hypertext and Hypermedia, pp.225--234, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Google Search Engine. http://www.google.com.Google ScholarGoogle Scholar
  10. Henzinger, M. R., Heydon, A., Mitzenmacher, M. and Najork, M., "Measuring Index Quality using Random Walks on the Web". In Proc. of the 8th Int. World Wide Web Conf. pp213--225, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Hofmann, T. and Buhmann, J. M., "Pairwise Data Clustering by Deterministic Annealing", in IEEE Trans. on Pattern Analysis and Machine Intelligence, 19(1): 1--14, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Huang, T. S., Mehrotra, S., and Ramchandran, K., "Multimedia analysis and retrieval system (MARS) project," In Proc of 33rd Annual Clinic on Library Application of Data Processing-Digital Image Access and Retrieval, 1996.Google ScholarGoogle Scholar
  13. Kleinberg, J. M., "Authoritative Sources in a Hyperlinked Environment." In Proc. of ACM-SIAM Symposium on Discrete Algorithms, pp. 668--677, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Kumar, R., Raghavan, P., Pajagopalan, S., and Tomkins, A., "Trawling the Web for Emerging Cyber-communities". In Proc. of the 8th Int. World Wide Web Conf. pp. 403--415, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Lempel, R. and Soffer, A., "PicASHOW: Pictorial Authority Search by Hyperlinks on the Web." In Proc. 10th Int. World Wide Web Conf., pp. 438--448, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Li, Q., Yang, J., and Zhuang, Y. T., "Web-based Multimedia Retrieval: Balancing out between Common Knowledge and Personalized Views". In Proc. of 2nd Int. Conf. on Web Information System and Engineering, pp. 100--109, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Lu, Y., Hu, C. H., Zhu, X. Q., Zhang, H. J. and Yang, Q. "A Unified Framework for Semantics and Feature Based Relevance Feedback in Image Retrieval Systems". In Proc. of ACM Multimedia, pp. 31--38, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Pirolli, P., Pitkow, J., and Rao, R., "Silk rom a Sow's Ear: Extracting Usable Structure from the Web." In Proc. ACM SIGCHI Conf. on Human Factors in Computing Systems, pp. 383--390, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Rafiei, D. and Mendelzon, A. O., "What is this Page Known for? Computing Web Page Reputations." In Proc. of Int. World Wide Web Conf. pp. 823--835, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Smith, J. R. and Chang, S. F., "VisualSEEk: a fully automated content-based image query system," in Proc. of ACM Multimedia 96, pp. 87--98, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Smith, J. R. and Chang, S. F., "Visually Searching the Web for Content. IEEE Multimedia Magazine, 4(3): 12--20, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Tansley, R., "The Multimedia Thesaurus: An Aid for Multimedia Information Retrieval and Navigation", Master Thesis, Computer Science, University of Southampton, UK, 1998.Google ScholarGoogle Scholar
  23. Yang, J., Zhuang, Y. T., Li, Q., "Search for Multi-Modality Data in Digital Libraries", in Proc. of 2nd IEEE Pacific-Rim Conference on Multimedia, pp. 482--489, China, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. OCTOPUS: aggressive search of multi-modality data using multifaceted knowledge base

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!