Premium
StyleBlit: Fast Example‐Based Stylization with Local Guidance
Author(s) -
Sýkora D.,
Jamriška O.,
Texler O.,
Fišer J.,
Lukáč M.,
Lu J.,
Shechtman E.
Publication year - 2019
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/cgf.13621
Subject(s) - computer science , stylized fact , field (mathematics) , computer graphics , transfer (computing) , computer vision , artificial intelligence , image (mathematics) , computer graphics (images) , algorithm , mathematics , parallel computing , pure mathematics , economics , macroeconomics
We present StyleBlit—an efficient example‐based style transfer algorithm that can deliver high‐quality stylized renderings in real‐time on a single‐core CPU. Our technique is especially suitable for style transfer applications that use local guidance ‐ descriptive guiding channels containing large spatial variations. Local guidance encourages transfer of content from the source exemplar to the target image in a semantically meaningful way. Typical local guidance includes, e.g., normal values, texture coordinates or a displacement field. Contrary to previous style transfer techniques, our approach does not involve any computationally expensive optimization. We demonstrate that when local guidance is used, optimization‐based techniques converge to solutions that can be well approximated by simple pixel‐level operations. Inspired by this observation, we designed an algorithm that produces results visually similar to, if not better than, the state‐of‐the‐art, and is several orders of magnitude faster. Our approach is suitable for scenarios with low computational budget such as games and mobile applications.