Open AccessJapanese experiment of a complete and objective automatic grading system of facial signs from selfie pictures: Validation with dermatologists and characterization of changes due to age and sun exposures
Author(s) -
Flament Frederic,
Velleman Damien,
Yamashita Eri,
Nicolas Alexandre,
Yokoyama Emilie,
Itaya Ayako,
Zhang Yuze,
Jiang Ruowei,
Aarabi Pahram,
Abric Aurelie,
Nakada Aya,
Sagawa Yoko,
Nishihara Haruna,
Morita Akimichi,
Cassier Matthieu,
Delaunay Caroline
Publication year - 2021
Publication title -
skin research and technology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.521
H-Index - 69
eISSN - 1600-0846
pISSN - 0909-752X
DOI - 10.1111/srt.12982
Subject(s) - selfie , medicine , ptosis , grading (engineering) , scoring system , orthodontics , surgery , computer science , world wide web , civil engineering , engineering
Abstract Objective To evaluate the capacity of the automatic detection system to accurately grade, from smartphones' selfie pictures, the severity of ten facial signs in Japanese women and their changes due to age and sun exposures. Methods A three‐step approach was conducted, based on self‐taken selfie images. At first, to check on 310 Japanese women (18‐69 years) enrolled in the northerner Hokkaido area (latitude 43.2°N), how, on ten facial signs, the A.I‐based automatic grading system may correlate with dermatological assessments, taken as reference. Second, to assess and compare age changes in 310 Japanese and 112 Korean women. Third, as these Japanese panelists were recruited according to their usual behavior toward sun exposure, that is, non‐sun‐phobic (NSP, N = 114) and sun‐phobic (SP, N = 196), and through their regular and early use of a photo‐protective product, to characterize the facial photo‐damages. Results (a) On the ten facial signs, detected automatically, nine were found significantly ( P < .0001) highly correlated with the evaluations made by three Japanese dermatologists (Wrinkles: r = .75; Sagging: r = .80; Pigmentation: r = .75). (b) The automatic scores showed significant changes with age, by decade, of Wrinkles/Texture, Pigmentation, and Ptosis/Sagging ( P < .05). (c) After 45 years, a significantly increased severity of Wrinkles/Texture and Pigmentation was observed in NSP vs. SP women ( P < .05). A trend of an increased Ptosis/Sagging ( P = .09) was observed. Conclusion This work illustrates, for the first time through investigations conducted at home, some impacts of aging and sun exposures on facial signs of Japanese women. Results significantly confirm the importance of sun avoidance coupled with photo‐protective measures. In epidemiological studies, the AI‐based system offers a fast, affordable, and confidential approach in detection and quantification of facial signs and their dependence with ages, environments and lifestyles.