Mask2Defect: A Prior Knowledge-Based Data Augmentation Method for Metal Surface Defect Inspection

In this paper, a new data augmentation algorithm, named Mask2Defect is proposed. Via prior knowledge based data infusing, this method is able to generate defects with varied features. Large volume of defects with different shapes, severities, scales, rotation angles, spatial locations, and part numbers can be generated in a controllable manner. These generated defects will work as teacher samples to fine-tune the inspection model, and automatically adapt it to a wider range of defects. To be specific, we first encode the prior knowledge into the teacher mask via the Industrial Prior Knowledge Encoder, and render the defect details according to the mask with the Mask-to-Defect Construction Network. Then, the Fake-to-Real Domain Transformation GAN is used to transform the rendered samples from the fake domain into the real defect domain. Experiments reveal that the synthesized image quality of our method outperforms the state-of-the-art generative methods, and the performance of the inspection model in defect classification and localization has also been improved by fine-tuned with the generated samples.