Yijuan Lu
ABSTRACT
Dimensionality reduction of a feature set is a common preprocessing step used for pattern recognition and classification applications. Principal Component Analysis (PCA) is one of the popular methods used, and can be shown to be optimal using different optimality criteria. However, it has the disadvantage that measurements from all the original features are used in the projection to the lower dimensional space. This paper proposes a novel method for dimensionality reduction of a feature set by choosing a subset of the original features that contains most of the essential information, using the same criteria as PCA. We call this method Principal Feature Analysis (PFA). The proposed method is successfully applied for choosing the principal features in face tracking and content-based image retrieval (CBIR) problems. Automated annotation of digital pictures has been a highly challenging problem for computer scientists since the invention of computers. The capability of annotating pictures by computers can lead to breakthroughs in a wide range of applications including Web image search, online picture-sharing communities, and scientific experiments. In our work, by advancing statistical modeling and optimization techniques, we can train computers about hundreds of semantic concepts using example pictures from each concept. The ALIPR (Automatic Linguistic Indexing of Pictures - Real Time) system of fully automatic and high speed annotation for online pictures has been constructed. Thousands of pictures from an Internet photo-sharing site, unrelated to the source of those pictures used in the training process, have been tested. The experimental results show that a single computer processor can suggest annotation terms in real-time and with good accuracy.
- Lisboa, P. J. G., Mehri-Dehnavi, R. Sensitivity Methods for Variable Selection Using the MLP. International Workshop on Neural Networks for Identification, Control, Robotics and Signal/Image, 1996, 330--338. Google Scholar
Digital Library
- Lin, T.-S., Meador, J. Statistical Feature Extraction and Selection for IC Test Pattern Analysis. Circuits and systems, vol 1., 1992, 391--394.Google Scholar
- Hocking, R. R. Development in Linear Regression Methodology: 1959-1982. Technometrics, vol. 25, 1983, 219--249.Google Scholar
- McCabe, G. P. Principal Variables. Technometrics, vol. 26, 1984, 127--134.Google Scholar
- Jolliffe, I. T. Principal Component Analysis. Springer-Verlag, New-York, 1986.Google Scholar
- Krzanowski, W. J. Selection of Variables to Preserve Multivariate Data Structure, Using Principal Component Analysis. Applied Statistics - Journal of the Royal Statistical Society Series C, vol. 36, 1987, 22--33.Google Scholar
- Krzanowski, W. J. A Stopping Rule for structure - Preserving Variable Selection. Statistics and Computing, March vol. 6, 1996, 51--56.Google Scholar
- Gower, J. C., Statistical Methods of Comparing Different Multivariate Analyses of the Same Data, Mathematics in the Archaeological and Historical Sciences, University Press, Edinburgh, 1971, 138--149.Google Scholar
Index Terms
Feature selection using principal feature analysis
Recommendations
Feature Selection Using Principal Component Analysis
Principal component analysis (PCA) has been widely applied in the area of computer science. It is well-known that PCA is a popular transform method and the transform result is not directly related to a sole feature component of the original sample. ...
Unsupervised feature selection using weighted principal components
Research highlights Unsupervised features selection method is proposed. The proposed method can successfully detect true significant features. Integration of PCA and control charts techniques. Feature selection has received considerable attention in ...
Locality-regularized linear regression discriminant analysis for feature extraction
Locality-regularized linear regression classification (LLRC) is an effective classifier that shows great potential for face recognition. However, the original feature space cannot guarantee the classification efficiency of LLRC. To alleviate this ...
Comments