Premium
Interactive Sketch‐Driven Image Synthesis
Author(s) -
Turmukhambetov Daniyar,
Campbell Neill D.F.,
Goldman Dan B,
Kautz Jan
Publication year - 2015
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/cgf.12665
Subject(s) - sketch , computer science , workflow , object (grammar) , artificial intelligence , computer vision , ellipse , computer graphics (images) , image (mathematics) , process (computing) , image editing , algorithm , mathematics , database , programming language , geometry
We present an interactive system for composing realistic images of an object under arbitrary pose and appearance specified by sketching. Our system draws inspiration from a traditional illustration workflow: The user first sketches rough ‘masses’ of the object, as ellipses, to define an initial abstract pose that can then be refined with more detailed contours as desired. The system is made robust to partial or inaccurate sketches using a reduced‐dimensionality model of pose space learnt from a labelled collection of photos. Throughout the composition process, interactive visual feedback is provided to guide the user. Finally, the user's partial or complete sketch, complemented with appearance requirements, is used to constrain the automatic synthesis of a novel, high‐quality, realistic image.