Back to articles
Volume: 31 | Article ID: art00006
Face Alignment via 3D-Assisted Features
  DOI :  10.2352/ISSN.2470-1173.2019.8.IMAWM-403  Published OnlineJanuary 2019

We present a practical 3D-assited face alignment framework based on cascaded regression in this paper. The 3D information embedded in 2D face image is utilized to calculate two novel components to improve the performance of 2D methods in unconstrained face alignment. The two novel components for 2D image features are the projected local patch and the visibility of each landmark. First, we propose to extract the landmark related features in the projected local patches on 2D image from the corresponding 3D face model. Local patches of a fixed landmark in 3D face models for different 2D images cover the same region of face anatomically. The extracted features are more accurate for further locations regression of landmarks. Second, we propose to estimate the visibilities of 2D landmarks based on 3D face model, which are proven to be vital to address large pose face alignment problem. In this paper, we adopt Local Binary Features (LBF) to extract landmark related features in the proposed framework, and name the new method as 3D-Assisted LBF (3DALBF). An extensive evaluation on two face databases shows that 3DALBF can achieve better alignment results than the original 2D method and maintain the speed advantage of 2D method over 3D method.

Subject Areas :
Views 11
Downloads 1
 articleview.views 11
 articleview.downloads 1
  Cite this article 

Song Guo, Fei Li, Hajime Nada, Hidetsugu Uchida, Tomoaki Matsunami, Narishige Abe, "Face Alignment via 3D-Assisted Featuresin Proc. IS&T Int’l. Symp. on Electronic Imaging: Imaging and Multimedia Analytics in a Web and Mobile World,  2019,  pp 403-1 - 403-8,

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2019
Electronic Imaging
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA