Search

This paper presents an approach to correcting misclassified pixels in depth maps representing parts of the human body. A misclassified pixel is a pixel of a depth map which, incorrectly, has the ‘background’ value and does not accurately reflect the distance from the sensor to the body being scanned. A completely automatic, deep learning based solution for depth map correction is proposed. As an input, the solution requires a color image and a corresponding erroneous depth map. The input color image is segmented using deep neural network for human body segmentation. The extracted segments are further used as guidance to find and amend the misclassified pixels on the depth map using a simple average based filter. Unlike other depth map refinement solutions, this paper designs a method for the improvement of the input depth map in terms of completeness instead of precision. The proposed method does not exclude the application of other refinement methods. Instead, it can be used as the first step in a depth map enhancement pipeline to determine approximate depths for erroneous pixels, while other refinement methods can be applied in a second step to improve the accuracy of the recovered depths.

The purpose of this article is to review 3D body scanning systems currently available in the market. 3D human scanning is a process of capturing and subsequent digitization of the full body or the body parts into their three-dimensional graphical representation. As 3D human body scanning techniques are becoming ubiquitous, we give an overview of the different technologies of 3D body data digitization such as techniques based on photogrammetry, depth sensors, and laser scanning as well as few more promising techniques. Also, the underlying principles that allow these systems to work are determined and explained. In order to provide directions for further integration of digitized 3D human bodies, specifications of 3D body scanning systems are compared, and a variety of commercial scanners available in the market are presented in the paper. [ABSTRACT FROM AUTHOR]