Modeling Character Canvases from Cartoon Drawings

ACM Transactions on Graphics, Volume 34 Issue 5, October 2015  [link]

Character drawings (c) are traditionally anchored around a skeleton (a), surrounded by generalized surfaces of revolution (b). We use the drawn character contours (d) and a corresponding 3D skeleton (red-to-blue coloring reflects near-to-far skeleton depth variation), to automatically compute a 3D canvas, employed to freely manipulate the character in 3D (e).
Paper
Video
Abstract

We introduce a novel technique for the construction of a 3D character proxy, or canvas, directly from a 2D cartoon drawing and a user-provided correspondingly posed 3D skeleton.

Our choice of input is motivated by the observation that traditional cartoon characters are well approximated by a union of generalized surface of revolution body parts, anchored by a skeletal structure. While typical 2D character contour drawings allow ambiguities in 3D interpretation, our use of a 3D skeleton eliminates such ambiguities and enables the construction of believable character canvases from complex drawings.

Our canvases conform to the 2D contours of the input drawings, and are consistent with the perceptual principles of Gestalt continuity, simplicity, and contour persistence.

We first segment the input 2D contours into individual body part outlines corresponding to 3D skeletal bones using the Gestalt continuation principle to correctly resolve inter-part occlusions in the drawings. We then use this segmentation to compute the canvas geometry, generating 3D generalized surfaces of revolution around the skeletal bones that conform to the original outlines and balance simplicity against contour persistence.

The combined method generates believable canvases for characters drawn in complex poses with numerous interpart occlusions, variable contour depth, and significant foreshortening. Our canvases serve as 3D geometric proxies for cartoon characters, enabling unconstrained 3D viewing, articulation and non-photorealistic rendering. We validate our algorithm via a range of user studies and comparisons to ground-truth 3D models, and artist drawn results. We further demonstrate a compelling gallery of 3D character canvases created from a diverse set of cartoon drawings with matching 3D skeletons.

BibTex
@article{ModelCharacterCanvases,
  author  = {Bessmeltsev, Mikhail and Chang, Will and Vining, Nicholas and Sheffer, Alla and Singh, Karan},
  title   = {Modeling Character Canvases from Cartoon Drawings},
  journal = {Transactions on Graphics (2015)},
  year    = {2015},
  volume = {34},
  number = {5},
  doi = {10.1145/2801134},
  publisher = {ACM},
  address = {New York, NY, USA}
}

All images are © ACM, 2015.