Abstract
In object-based image retrieval, there are two important issues: an effective image representation method for representing image content and an effective image classification method for processing user feedback to find more images containing the user-desired object categories. In the image representation method, the local-based representation is the best selection for object-based image retrieval. As a kernel-based classification method, Support Vector Machine (SVM) has shown impressive performance on image classification. But SVM cannot work on the local-based representation unless there is an appropriate kernel. To address this problem, some representative kernels are proposed in literatures. However, these kernels cannot work effectively in object-based image retrieval due to ignoring the spatial context and the combination of local features.
In this article, we present Adjacent Matrix (AM) and the Local Combined Features (LCF) to incorporate the spatial context and the combination of local features into the kernel. We propose the AM-LCF feature vector to represent image content and the AM-LCF kernel to measure the similarities between AM-LCF feature vectors. According to the detailed analysis, we show that the proposed kernel can overcome the deficiencies of existing kernels. Moreover, we evaluate the proposed kernel through experiments of object-based image retrieval on two public image sets. The experimental results show that the performance of object-based image retrieval can be improved by the proposed kernel.
- Carson, C., Belongie, S., Greenspan, H., and Malik, J. 2004. Blobworld: Image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1026--1038. Google Scholar
Digital Library
- Chapelle, O., Haffiner, P., and Vapnik, V. 1999. Svms for histogram-based image classification. IEEE Trans. Neural Netw. 10, 234--778. Google Scholar
Digital Library
- Felzenszwalb, P. F. and Huttenlocher, D. P. 2004. Efficient graph-based image segmentation. Inte. J. Comput. Vis. 59, 167--181. Google Scholar
Digital Library
- Gosselin, P. H., Cord, M., and Foliguet, S. P. 2007a. Kernels on bags for multi-object database retrieval. In Proceedings of the 6th ACM International Conference on Image and Video Retrieval. 226--231. Google Scholar
Digital Library
- Gosselin, P. H., Cord, M., and Foliguet, S. P. 2007b. Kernels on bags of fuzzy regions for fast object retrieval. In Proceedings of IEEE International Conference on Image Processing. 177--180.Google Scholar
- Gosselin, P. H., Cord, M., and Foliguet, S. P. 2008. Combining visual dictionary, kernel-based similarity and learning strategy for image category retrieval. Comput. Vis. Image Understand. 110, 403--417. Google Scholar
Digital Library
- Grauman, K. and Darrell, T. 2005. The pyramid match kernel: Discriminative classification with sets of image features. InProceedings of the 10th IEEE International Conference on Computer Vision. Vol. 2, 1458--1465. Google Scholar
Digital Library
- Grauman, K. and Darrell, T. 2007. Approximate correspondences in high dimensions. Adv. in Neural Inf. Process. Syst. 19, 505--512.Google Scholar
- Griffin, G., Holub, A., and Perona, P. 2007. Caltech-256 object category dataset. Tech. rep. 7694, California Institute of Technology.Google Scholar
- Harchaoui, Z. and Bach, F. 2007. Image classification with segmentation graph kernels. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 1--8.Google Scholar
- Haussler, D. 1999. Convolution kernel for structure data. Tech. rep. UCS-CRL-99-10.Google Scholar
- Hsiao, J. H. and Chen, M. S. 2009. Intention-Focused active reranking for image object retrieval. In Proceedings of the 18th ACM Conference on Information and Knowledge Management. 157--166. Google Scholar
Digital Library
- Hsu, C. W., C Hang, C. C., and Lin, C. J. 2003. A practical guide to support vector classification. Tech. rep. Department of Computer Science, National Taiwan University.Google Scholar
- Kou, Y. H., Chen, K. T., Chiang, C. H., and Hsu, W. H. 2009. Query expansion for hash-based image object retrieval. In Proceedings of the 17th ACM International Conference on Multimedia. 65--74. Google Scholar
Digital Library
- Lazebnik, S., Schmid, C., and Ponce, J. 2006. Beyond bags of features: Spatial pyramid matching for recognizing natural scence categories. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2169--2178. Google Scholar
Digital Library
- Lebrun, J., Foliguet, S. P., and Gosselin, P. H. 2008. Image retrieval with graph kernel on regions. In Proceedings of the 19th International Conference on Pattern Recognition. 1--4.Google Scholar
- Lyu, S. 2005. Mercer kernels for object recognition with local features. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Vol. 2, 223--229. Google Scholar
Digital Library
- Perronnin, F. and Dance, C. 2007. Fisher kernels on visual vocabularies for image categorization. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 1--8.Google Scholar
- Philbin, J., Chum, O., Isard, M., Sivic, J., and Zisserman, A. 2008. Lost in quantization: Improving particular object retrieval in large scale image databases. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 1--8.Google Scholar
- Pontil, M. and Verri, A. 1998. Support vector machines for 3d object recognition. IEEE Trans. Pattern Anal. Mach. Intell. 20, 637--646. Google Scholar
Digital Library
- Shawe-Taylor, J. and Cristianini, N. 2004. Kernel Methods for Pattern Analysis. Cambridge University Press. Google Scholar
Digital Library
- Sivic, J. and Zisserman, A. 2003. Video google: A text retrieval approach to object matching in videos. In Proceedings of the 9th IEEE International Conference on Computer Vision. Vol. 2, 1470--1477. Google Scholar
Digital Library
- Vapnik, V. 1998. Statistical learning theory. John Wiley & Sons, New York.Google Scholar
- Wallraven, C. and Caputo, B. 2003. Recognition with local features: the kernel recipe. In Proceedings of the 9th IEEE International Conference on Computer Vision. Vol. 2, 257--264. Google Scholar
Digital Library
- Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., and Gong, Y. 2010. Locality-Constrained linear coding for image classification. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 3360--3367.Google Scholar
- Wang, J. Z., Li, J., and Wiederhold, G. 2001. Simplicity: Semantics-Sensitive integrated matching for picture libraries. IEEE Trans. Pattern Analy. Mach. Intell. 23, 947--963. Google Scholar
Digital Library
- Zhang, L., Lin, F. Z., and Zhang, B. 2001. Support vector machine learning for image retrieval. In Proceedings of International Conference on Image Processing. Vol. 2, 721--724.Google Scholar
- Zheng, Q. F. and Gao, W. 2008. Constructing visual phrases for effective and efficient object-based image retrieval. ACM Trans. Multimedia Comput. Comm. Appli. 5, 7:1--7:19. Google Scholar
Digital Library
Index Terms
Object-based image retrieval with kernel on adjacency matrix and local combined features
Recommendations
Constructing visual phrases for effective and efficient object-based image retrieval
The explosion of multimedia data necessitates effective and efficient ways for us to get access to our desired ones. In this article, we draw an analogy between image retrieval and text retrieval and propose a visual phrase-based approach to retrieve ...
Effective and efficient object-based image retrieval using visual phrases
MM '06: Proceedings of the 14th ACM international conference on MultimediaIn this paper, we draw an analogy between image retrieval and text retrieval and propose a visual phrase-based approach to retrieve images containing desired objects. The visual phrase is defined as a pair of adjacent local image patches and is ...
Object Based Image Retrieval from Database Using Combined Features
ICSIP '14: Proceedings of the 2014 Fifth International Conference on Signal and Image ProcessingContent based image retrieval (CBIR) is a promising way to address image retrieval based on the visual features of an image like color, texture and shape. Every visual feature will address a specific property of the image, so the state of the art ...






Comments