Open AccessAutomatic facial flaw detection and retouching via discriminative structure tensor
Author(s) -
Liu Xin,
Xie Lu,
Zhong Bineng,
Du JiXiang,
Peng Qinmu
Publication year - 2017
Publication title -
iet image processing
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.401
H-Index - 45
eISSN - 1751-9667
pISSN - 1751-9659
DOI - 10.1049/iet-ipr.2016.1095
Subject(s) - computer science , discriminative model , artificial intelligence , inpainting , face (sociological concept) , tensor (intrinsic definition) , computer vision , structure tensor , pattern recognition (psychology) , image (mathematics) , mathematics , social science , sociology , pure mathematics
Facial retouching has been increasingly applied in current social media and entertainment industries. In this study, the authors propose an efficient approach to automatically detect and retouch the facial flaws by using discriminative structure tensor. First, a non‐linear structure tensor associated with saliency model is exploited to discriminatively and automatically detect the significant facial flaws. Then, a Gaussian skin model is constructed in YCbCr space and the OSTU operation is simultaneously utilised to precisely mark the facial skin regions, in which the mouth, eyebrows and nostril parts are excluded. Subsequently, diverse structure tensor is employed to discriminatively adjust the inpainting priority and propose a structure tensor‐based inpainting algorithm to retouch the detected flaws. Without manual intervention, the extensive experiments have shown its effectiveness in marking the freckles, blemishes and moles in face images, and the retouching performance is visually pleasing in comparison with state‐of‐the‐art counterparts.