1. Face analysis through semantic face segmentation
- Author
-
Massimo Mauro, Khalil Khan, Riccardo Leonardi, Pierangelo Migliorati, and Sergio Benini
- Subjects
Head pose estimation ,Head (linguistics) ,Computer science ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Face expression classification ,02 engineering and technology ,Face segmentation ,Gender recognition ,Software ,Signal Processing ,1707 ,Electrical and Electronic Engineering ,Discriminative model ,0202 electrical engineering, electronic engineering, information engineering ,Segmentation ,Pose ,business.industry ,020206 networking & telecommunications ,Pattern recognition ,Expression (mathematics) ,Random forest ,Support vector machine ,Face (geometry) ,020201 artificial intelligence & image processing ,Computer Vision and Pattern Recognition ,Artificial intelligence ,business - Abstract
Automatic face analysis, including head pose estimation, gender recognition, and expression classification, strongly benefits from an accurate segmentation of the human face. In this paper we present a multi-feature framework which first segments a face image into six parts, and then performs classification tasks on head pose, gender, and expression. Segmentation is achieved by training a discriminative model on a manually labeled face database, namely FASSEG , which we extend from previous versions, and which we publicly share. Three kinds of features accounting for location, shape, and color are extracted from uniformly sampled square image patches. Facial images are then pixel-wise segmented into six semantic classes – hair, skin, nose, eyes, mouth, and background, – using a Random Forest classifier (RF). Then a linear Support Vector Machine (SVM) is trained for each face analysis task i.e., head pose estimation, gender recognition, and expression classification by using the probability maps obtained during the segmentation step. Performance of the proposed framework is evaluated on four face databases, namely Pointing’04, FEI, FERET, and MPI, with results which outperform the current state-of-the-art.
- Published
- 2019
- Full Text
- View/download PDF