GAMES Webinar 2018-72期(Human Performance Capture Tutorial-4)| Michael Zollhöfer(斯坦福大学),郭凯文(谷歌)

【GAMES Webinar 2018-72期(Human Performance Capture Tutorial-4)】
报告嘉宾1:Michael Zollhöfer,斯坦福大学
报告时间:2018年11月8日 下午2:00-2:45(北京时间)
报告题目:Is It Real? Facial Motion Capture and Reenactment using Deep Neural Networks
A broad range of applications in visual effects, computer animation, autonomous driving, and man-machine interaction heavily depend on robust and fast algorithms to obtain high-quality reconstructions of our physical world in terms of geometry, motion, reflectance, and illumination. Especially, with the increasing popularity of virtual, augmented and mixed reality devices, there comes a rising demand for real-time and low-latency solutions.
This talk covers data-parallel optimization and state-of-the-art machine learning techniques to tackle the underlying 3D and 4D reconstruction problems based on novel mathematical models and fast algorithms. The particular focus of this talk is on self-supervised face reconstruction from a collection of unlabeled in-the-wild images. The proposed approach can be trained end-to-end without dense annotations by fusing a convolutional encoder with a differentiable expert-designed renderer and a self-supervised training loss.
The resulting reconstructions are the foundation for advanced video editing effects, such as photo-realistic re-animation of portrait videos. The core of the proposed approach is a generative rendering-to-video translation network that takes computer graphics renderings as input and generates photo-realistic modified target videos that mimic the source content. With the ability to freely control the underlying parametric face model, we are able to demonstrate a large variety of video rewrite applications. For instance, we can reenact the full head using interactive user-controlled editing and realize high-fidelity visual dubbing.
Michael Zollhöfer is a Visiting Assistant Professor at Stanford University. His stay at Stanford is funded by a postdoctoral fellowship of the Max Planck Center for Visual Computing and Communication (MPC-VCC), which he received for his work in the fields of computer vision, computer graphics, and machine learning. Before joining Stanford University, Michael was a Postdoctoral Researcher at the Max Planck Institute for Informatics working with Christian Theobalt. He received his PhD from the University of Erlangen-Nuremberg for his work on real-time reconstruction of static and dynamic scenes. During his PhD, he was an intern at Microsoft Research Cambridge working with Shahram Izadi on data-parallel optimization for real-time template-based surface reconstruction. The primary goal of his research is to teach computers to reconstruct and analyze our world at frame rate based on visual input. To this end, he develops key technology to invert the image formation models of computer graphics based on data-parallel optimization and state-of-the-art deep learning techniques. The reconstructed intrinsic scene properties, such as geometry, motion, reflectance, and illumination are the foundation for a broad range of applications not only in virtual and augmented reality, visual effects, computer animation, autonomous driving, and man-machine interaction, but also in other fields such as medicine and biomechanics.


报告时间:2018年11月8日 下午2:45-3:30(北京时间)
郭凯文,谷歌研究员。分别于2011年和2017年在东北大学、清华大学自动化系获得工学学士和工学博士学位。20017年加入谷歌继续三维计算机视觉研究工作。研究方向为三维计算机视觉,包括三维重建、运动捕捉。已发表ACM TOG、IEEE CVPR、ICCV、ECCV、TVCG等领域重要期刊及会议论文多篇。


GAMES主页的“使用教程”中有 “如何观看GAMES Webinar直播?”及“如何加入GAMES微信群?”的信息;



Liu, Ligang

刘利刚,中国科学技术大学教授、博导。分别于1996年及2001年于浙江大学获得应用数学学士及博士学位。从事计算机图形学研究,已在该领域顶级期刊ACM Transactions on Graphics上发表论文三十余篇。曾于微软亚洲研究院、浙江大学、哈佛大学工作或访问。曾获微软青年教授奖、陆增镛CAD&CG高科技奖一等奖、国家自然科学奖二等奖等奖项。任多个国内外会议的大会共同主席或论文共同主席及多个国际学术期刊编委。负责创建了中科大《计算机图形学前沿》暑期课程及CCF CAD&CG专委图形学在线交流平台GAMES。

You may also like...