1. FASSD-Net Model for Person Semantic Segmentation
- Author
-
Gabriel Sanchez-Perez, Jesus Olivares-Mercado, Jose Portillo-Portillo, Luis Brandon Garcia-Ortiz, Aldo Hernandez-Suarez, Hector Perez-Meana, Karina Toscano-Medina, and Gibran Benitez-Garcia
- Subjects
Scheme (programming language) ,TK7800-8360 ,Computer Networks and Communications ,Computer science ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,02 engineering and technology ,Convolutional neural network ,cityscapes ,Task (project management) ,Silhouette ,0502 economics and business ,0202 electrical engineering, electronic engineering, information engineering ,Segmentation ,Electrical and Electronic Engineering ,computer.programming_language ,050210 logistics & transportation ,Class (computer programming) ,business.industry ,Deep learning ,05 social sciences ,deep learning ,Pattern recognition ,semantic segmentation ,Identification (information) ,Hardware and Architecture ,Control and Systems Engineering ,human silhouette ,Signal Processing ,020201 artificial intelligence & image processing ,Artificial intelligence ,Electronics ,business ,computer ,person class - Abstract
This paper proposes the use of the FASSD-Net model for semantic segmentation of human silhouettes, these silhouettes can later be used in various applications that require specific characteristics of human interaction observed in video sequences for the understanding of human activities or for human identification. These applications are classified as high-level task semantic understanding. Since semantic segmentation is presented as one solution for human silhouette extraction, it is concluded that convolutional neural networks (CNN) have a clear advantage over traditional methods for computer vision, based on their ability to learn the representations of appropriate characteristics for the task of segmentation. In this work, the FASSD-Net model is used as a novel proposal that promises real-time segmentation in high-resolution images exceeding 20 FPS. To evaluate the proposed scheme, we use the Cityscapes database, which consists of sundry scenarios that represent human interaction with its environment (these scenarios show the semantic segmentation of people, difficult to solve, that favors the evaluation of our proposal), To adapt the FASSD-Net model to human silhouette semantic segmentation, the indexes of the 19 classes traditionally proposed for Cityscapes were modified, leaving only two labels: One for the class of interest labeled as person and one for the background. The Cityscapes database includes the category “human” composed for “rider” and “person” classes, in which the rider class contains incomplete human silhouettes due to self-occlusions for the activity or transport used. For this reason, we only train the model using the person class rather than human category. The implementation of the FASSD-Net model with only two classes shows promising results in both a qualitative and quantitative manner for the segmentation of human silhouettes.
- Published
- 2021