GAMES Webinar 2018-47期 | 朱宏国,台湾清华大学

【GAMES Webinar 2018-47期】
报告时间:2018年5月24日(星期四)晚20:00 – 21:30(北京时间)
报告题目:Interactive Videos: Plausible Video Editing using Sparse Structure Points
Video remains the method of choice for capturing temporal events. However, without access to the underlying 3D scene models, it remains difficult to make object level edits in a single video or across multiple videos. While it may be possible to explicitly reconstruct the 3D geometries to facilitate these edits, such a workflow is cumbersome, expensive, and tedious. In this work, we present a much simpler workflow to create plausible editing and mixing of raw video footage using only sparse structure points (SSP) directly recovered from the raw sequences. First, we utilize user-scribbles to structure the point representations obtained using structure-from-motion on the input videos. The resultant structure points, even when noisy and sparse, are then used to enable various video edits in 3D, including view perturbation, keyframe animation, object duplication and transfer across videos, etc. Specifically, we describe how to synthesize object images from new views adopting a novel image-based rendering technique using the SSPs as proxy for the missing 3D scene information. We propose a structure-preserving image warping on multiple input frames adaptively selected from object video, followed by a spatio-temporally coherent image stitching to compose the final object image. Simple planar shadows and depth maps are synthesized for objects to generate plausible video sequence mimicking real-world interactions. We demonstrate our system on a variety of input videos to produce complex edits, which are otherwise difficult to achieve.
Hung-Kuo Chu is an associate professor at the Department of Computer Science, National Tsing Hua University. He received BS and Ph.D degrees from Department of Computer Science and Information Engineering, National Cheng-Kung University in 2003 and 2010, respectively. His research interests focus on Shape Understanding, Smart Manipulation, Perception-based Rendering, Recreational Graphics, Human Computer Interaction, and Virtual/Augmented/Mixed Reality.

GAMES主页的“使用教程”中有 “如何观看GAMES Webinar直播?”及“如何加入GAMES微信群?”的信息;



Liu, Ligang

刘利刚,中国科学技术大学教授,曾获得中国科学院“百人计划”、国家优青、杰青,从事计算机图形学研究。分别于1996年及2001年于浙江大学获得应用数学学士及博士学位。曾于微软亚洲研究院、浙江大学、哈佛大学工作或访问。曾获微软青年教授奖、陆增镛CAD&CG高科技奖一等奖、国家自然科学奖二等奖等奖项。负责创建了中科大《计算机图形学前沿》暑期课程及CCF CAD&CG专委图形学在线交流平台GAMES。

You may also like...