Eigenfaces are a set of eigenvectors derived from the covariance matrix of the probability distribution of the high-dimensional vector space of possible faces of human beings. These eigenvectors are used in the computer vision problem of human face recognition.

In layperson's terms, eigenfaces are a set of "standardized face ingredients", derived from statistical analysis of many pictures of faces. Any human face can be considered to be a combination of these standard faces. One person's face might be made up of 10% from face 1, 24% from face 2 and so on. This means that if you want to record someone's face for use by face recognition software you can use far less space than would be taken up by a digitised photograph.

To generate a set of eigenfaces, a large set of digitized images of human faces, taken under the same lighting conditions, are normalized to line up the eyes and mouths. They are then all resampled at the same pixel resolution (say m×n), and then treated as mn-dimensional vectors whose components are the values of their pixels. The eigenvectors of the covariance matrix of the statistical distribution of face image vectors are then extracted.

Since the eigenvectors belong to the same vector space as face images, they can be viewed as if they were m×n pixel face images: hence the name eigenfaces.

Viewed in this way, the principal eigenface looks like a bland androgynous average human face. Some subsequent eigenfaces can be seen to correspond to generalized features such as left-right and top-bottom asymmetry, or the presence or lack of a beard. Other eigenfaces are hard to categorize, and look rather strange.

When properly weighted, eigenfaces can be summed together to create an approximate gray-scale rendering of a human face. Remarkably few eigenvector terms are needed to give a fair likeness of most people's faces, so eigenfaces provide a means of applying data compression to faces for identification purposes.

to do: handling variations in facial expression and lighting conditions

References

• [1]
• M. Turk and A. Pentland (1991) "Eigenfaces for recognition". Journal of Cognitive Neuroscience 3 (1), 71–86. [2]
• A. Pentland, B. Moghaddam, T. Starner, O. Oliyide, and M. Turk. (1993). "View-based and modular Eigenspaces for face recognition". Technical Report 245, M.I.T Media Lab. [3]

See also

• 3D computer graphics
• computer animation
• pattern recognition
• human appearance
• principal components analysis
• facial recognition system

External Links

• ID One, Inc. - a leader in facial recognition technology