GAMES Webinar 2022 – 219期(虚拟环境构建:3D视频会议与群体运动生成) | Yizhong Zhang (Microsoft Research Asia),尹泰然 (Inria(法国国家信息化和自动化研究所))

【GAMES Webinar 2022-219期】(VR&AR专题-虚拟环境构建:3D视频会议与群体运动生成)

报告嘉宾:Yizhong Zhang(Microsoft Research Asia)


报告题目:VirtualCube: An Immersive 3D Video Communication System


The VirtualCube system is a 3D video conference system that attempts to overcome some limitations of conventional technologies. The key ingredient is VirtualCube, an abstract representation of a real-world cubicle instrumented with RGBD cameras for capturing the user’s 3D geometry and texture. We design VirtualCube so that the task of data capturing is standardized and significantly simplified, and everything can be built using off-the-shelf hardware. We use VirtualCubes as the basic building blocks of a virtual conferencing environment, and we provide each VirtualCube user with a surrounding display showing life-size videos of remote participants. To achieve real-time rendering of remote participants, we develop the V-Cube View algorithm, which uses multi-view stereo for more accurate depth estimation and Lumi-Net rendering for better rendering quality. The VirtualCube system correctly preserves the mutual eye gaze between participants, allowing them to establish eye contact and be aware of who is visually paying attention to them. The system also allows a participant to have side discussions with remote participants as if they were in the same room. Finally, the system sheds lights on how to support the shared space of work items (e.g., documents and applications) and track participants’ visual attention to work items.


Yizhong Zhang is a researcher at Microsoft Research Asia. He received his Ph.D. in computer science 2016 and B.S. in mechanical engineering 2010, both from Zhejiang University. His research interests include computational fabrication, physically based simulation, 3D reconstruction and robotics.




报告题目:The One-Man-Crowd: Single User Generation of Crowd Motions Using Virtual Reality


Crowd motion data is fundamental for understanding and simulating realistic crowd behaviours. Such data is usually collected through controlled experiments to ensure that both desired individual interactions and collective behaviours can be observed. It is however scarce, due to ethical concerns and logistical difficulties involved in its gathering, and only covers a few typical crowd scenarios. In this work, we propose and evaluate a novel Virtual Reality based approach lifting the limitations of real-world experiments for the acquisition of crowd motion data. Our approach immerses a single user in virtual scenarios where he/she successively acts each crowd member. By recording the past trajectories and body movements of the user, and displaying them on virtual characters, the user progressively builds the overall crowd behaviour by him/herself. We validate the feasibility of our approach by replicating three real experiments, and compare both the resulting emergent phenomena and the individual interactions to existing real datasets. Our results suggest that realistic collective behaviours can naturally emerge from virtual crowd data generated using our approach, even though the variety in behaviours is lower than in real situations. These results provide valuable insights to the building of virtual crowd experiences, and reveal key directions for further improvements.


Tairan Yin is a second year PhD candidate of Inria, under the supervision of Julien Pettré and Marie-Paule Cani. His research domain is crowd simulation and he is currently working on exploring new methods for the population of virtual scenes. Since the beginning of this research, Tairan Yin has been working with Motion Capture and Virtual Reality. His research is part of CLIPE project.



刘艳丽,四川大学计算机学院教授、博士生导师、视觉合成图形图像技术国防重点学科实验室副主任、四川大学中青年科技创新领军人才。2010年6月博士毕业于浙江大学CAD&CG国家重点实验室,2010年11月至2011年11月在法国国家信息科学与控制研究院(INRIA)从事博士后研究。长期从事增强现实中的视觉真实感呈现、自然场景光影分析与处理、面向识别的人脸图像处理等方向的研究,在IEEE TVCG、IEEE TMM、ACM MM等国际重要学术期刊和会议上发表论文40余篇。先后主持和主研多项国家自然科学基金、国家863计划课题、国家科技支撑计划课题、省部级课题和企业合作项目。2012年荣获陆增镛CAD&CG高科技奖,2019年获得四川省海外高层次留学人才称号。


GAMES主页的“使用教程”中有 “如何观看GAMES Webinar直播?”及“如何加入GAMES微信群?”的信息;

You may also like...