IEEE Transactions on Visualization and Computer Graphics (TVCG) 2017

DrawFromDrawings: 2D Drawing Assistance via Stroke Interpolation with a Sketch Database

Yusuke Matsui
The University of Tokyo
Takaaki Shiratori
Facebook Reality Labs
Kiyoharu Aizawa
The University of Tokyo

Abstract

We present DrawFromDrawings, an interactive drawing system that provides users with visual feedback for assistance in 2D drawing using a database of sketch images. Following the traditional imitation and emulation training from art education, DrawFromDrawings enables users to retrieve and refer to a sketch image stored in a database and provides them with various novel strokes as suggestive or deformation feedback. Given regions of interest (ROIs) in the user and reference sketches, DrawFromDrawings detects as-long-as-possible (ALAP) stroke segments and the correspondences between user and reference sketches that are the key to computing seamless interpolations. The stroke-level interpolations are parametrized with the user strokes, the reference strokes, and new strokes created by warping the reference strokes based on the user and reference ROI shapes, and the user study indicated that the interpolation could produce various reasonable strokes varying in shapes and complexity. DrawFromDrawings allows users to either replace their strokes with interpolated strokes (deformation feedback) or overlays interpolated strokes onto their strokes (suggestive feedback). The other user studies on the feedback modes indicated that the suggestive feedback enabled drawers to develop and render their ideas using their own stroke style, whereas the deformation feedback enabled them to finish the sketch composition quickly.

Video

Publication

  • DrawFromDrawings: 2D Drawing Assistance via Stroke Interpolation with a Sketch Database
    Yusuke Matsui, Takaaki Shiratori, Kiyoharu Aizawa
    IEEE Transactions on Visualization and Computer Graphics (TVCG), 2017

BibTeX

@article{tvcg_matsui_2017,
    author={Yusuke Matsui and Takaaki Shiratori and Kiyoharu Aizawa},
    journal={IEEE Transactions on Visualization and Computer Graphics},
    title={DrawFromDrawings: 2D Drawing Assistance via Stroke Interpolation with a Sketch Database},
    year={2017},
    volume={23},
    number={7},
    pages={1852-1862}
}