Facial Deblur Inference using Subspace Analysis for Recognition of Blurred Faces
[Abstract]
This paper proposes a novel method for recognizing faces degraded by
blur using deblurring of facial images. The main issue is how to infer a
Point Spread Function (PSF) representing the process of blur on
faces. Inferring a PSF from a single facial image is an ill-posed
problem. Our method uses learned prior information derived from a
training set of blurred faces to make the problem more tractable. We
construct a feature space such that blurred faces degraded by the same
PSF are similar to one another. We learn statistical models that
represent prior knowledge of predefined PSF sets in this feature
space. A query image of unknown blur is compared with each model and the
closest one is selected for PSF inference. The query image is deblurred
using the PSF corresponding to that model, and thus ready for
recognition. Experiments on a large face database (FERET) artificially
degraded by focus or motion blur show that our method substantially
improves the recognition performance compared to existing methods. We
also demonstrate improved performance on real blurred images on FRGC 1.0
face database. Furthermore, we show and explain how combining the
proposed facial deblur inference with the local phase quantization (LPQ)
method can further enhance the performance.
[Publications]
- Masashi Nishiyama, Abdenour Hadid, Hidenori Takeshima,
Jamie Shotton, Tatsuo Kozakaya, and Osamu Yamaguchi,
Facial Deblur Inference using Subspace Analysis for Recognition
of Blurred Faces,
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 33, no. 4, pp. 838 - 845, April 2011.
- Abdenour Hadid, Masashi Nishiyama, and Yoichi Sato,
Recognition of Blurred Faces via Facial Deblurring Combined with Blur-Tolerant Descriptors,
Proceedings of 20th International Conference on Pattern Recognition
(ICPR), pp. 1160 - 1163, August 2010.
- Masashi Nishiyama, Hidenori Takeshima, Jamie Shotton, Tatsuo Kozakaya,
and Osamu Yamaguchi,
Facial Deblur Inference to Improve Recognition of Blurred Faces,
Proceedings of IEEE Computer Society Conference on Computer Vision and
Pattern (CVPR), pp. 1115 - 1122, June 2009.
[Publication (Japanese) ]
- 西山 正志, 竹島 秀則, 小坂谷 達夫, 山口 修,
顔認識におけるぼけ除去のためのPSF推定,
情処研報 CVIM161-11, pp. 61 - 68,
January 2008.
[山下記念研究賞]