Video Stylization: Painterly Rendering and Optimization with Content Extraction Liang Lin, Kun Zeng, Yizhou Wang, Ying-Qing Xu, Senior Member, IEEE, and Song-Chun Zhu
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 23, NO. 4, APRIL 2013 577 Video Stylization: Painterly Rendering and Optimization With Content Extraction Liang Lin, Kun Zeng, Yizhou Wang, Ying-Qing Xu, Senior Member, IEEE, and Song-Chun Zhu Abstract—We present an interactive video stylization system an example produced by our system. Although similar oil- for transforming an input video into a painterly animation. painting effects can be generated manually by the paint- The system consists of two phases: a content extraction phase on-glass technique, such animation production is not only to obtain semantic objects, i.e., recognized content, in a video and establish dense feature correspondences, and a painterly laborious but also requires considerable artistic skills. For rendering phase to select, place, and propagate brush strokes example, it took over two years for artists to manually produce for stylized animations based on the semantic content and object the 22-min Oscar-winning animation Old Man and the Sea.In motions derived from the first phase. Compared with the previous comparison, our interactive system allows an amateur player work, the proposed method has the following three advantages. to produce painterly animations from real-life video clips with First, we propose a two-pass rendering strategy and brush strokes with mixed colors in order to render expressive visual effects. far less time and effort. Second, the brush strokes are warped according to global object In the following, we review the related work for painterly deformations, so that the strokes appear to be naturally attached rendering and video stylization in the literature and provide to the object surfaces.
[Show full text]