Deep mesh labeling via learned semantic boundary guidance

We propose a novel method for 3D mesh labeling based on a deep learning approach. We train two deep networks to produce initial labels and semantic boundary maps for test meshes. By using dropout technique, discriminative features can be extracted from our deep networks to improve mesh labeling and boundary detection. Given the detected boundary map, a smoother distance field with closed boundary depiction is calculated for succeeding optimization. Then, based on the initial labels, we obtain the final smooth results through a graph-cut optimization guided by the semantic boundary distance field. With the semantic boundary guidance, labeling is improved distinctly, especially, when large mislabeling regions appear or the boundary of initial labels is not reliable. Furthermore, our algorithm is robust to mesh noise, and can handle mixed dataset with meshes from different categories effectively. Experimental results show that our method outperforms the state-of-the-art methods on public benchmarks.