1. OmniEyes: Analysis and Synthesis of Artistically Painted Eyes
- Author
-
Strezoski, G., Knoester, R., van Noord, N., Worring, M., Ro, Y.M., Cheng, W.-C., Kim, J., Chu, W.-T., Cui, P., Choi, J.-W., Hu, M.-C., De Neve, W., and Multimedia Analytics Lab (IvI, FNWI)
- Subjects
Metadata ,Painting ,Portrait ,Computer science ,0202 electrical engineering, electronic engineering, information engineering ,Inpainting ,020201 artificial intelligence & image processing ,Context (language use) ,02 engineering and technology ,010501 environmental sciences ,01 natural sciences ,0105 earth and related environmental sciences ,Visual arts - Abstract
Faces in artistic paintings most often contain the same elements (eyes, nose, mouth...) as faces in the real world, however they are not a photo-realistic transfer of physical visual content. These creative nuances the artists introduce in their work act as interference when facial detection models are used in the artistic domain. In this work we introduce models that can accurately detect, classify and conditionally generate artistically painted eyes in portrait paintings. In addition, we introduce the OmniEyes Dataset that captures the essence of painted eyes with annotated patches from 250 K artistic paintings and their metadata. We evaluate our approach in inpainting, out of context eye generation and classification on portrait paintings from the OmniArt dataset. We conduct a user case study to further study the quality of our generated samples, asses their aesthetic aspects and provide quantitative and qualitative results for our model’s performance.
- Published
- 2020