GAMES Webinar 2026 – 418期(迈向通用具身智能:交互式世界模拟与机器人学习范式)|汪怡暄(英伟达 & 哥伦比亚大学),郝策(北京中关村学院)

GAMES Webinar 2026 – 418期(迈向通用具身智能:交互式世界模拟与机器人学习范式)

报告嘉宾:汪怡暄(英伟达 & 哥伦比亚大学)

报告时间:2026年10月15日 早上09:00-09:30(北京时间)

报告题目:

面向机器人策略训练与评估的交互式世界模拟器

Interactive World Simulator for Robot Policy Training and Evaluation

报告摘要:

机器人策略的训练与评估依赖大量真实交互,成本高且难以规模化。本报告介绍交互式世界模拟器 Interactive World Simulator(IWS),一种从机器人交互数据中学习的动作条件世界模型。该方法将一致性模型用于图像解码与潜空间动力学预测,在单张 RTX 4090 上实现每秒 15 帧、持续超过 10 分钟的稳定交互。在刚体、可变形物体及物体堆操作任务中,IWS 可用于生成示范数据以训练模仿学习策略,并支持可复现的闭环策略评估。实验表明,在所测试的任务中,模拟器生成数据训练的策略可达到与等量真实数据训练相当的表现,模拟评估结果也与真实机器人表现具有较强相关性。

Training and evaluating robot policies requires extensive real-world interaction, which is costly and difficult to scale. This talk introduces Interactive World Simulator (IWS), an action-conditioned world model learned from robot interaction data. By applying consistency models to image decoding and latent-space dynamics prediction, IWS enables stable interaction for over 10 minutes at 15 frames per second on a single RTX 4090 GPU. Across manipulation tasks involving rigid objects, deformable objects, and object piles, IWS supports demonstration generation for imitation learning and reproducible closed-loop policy evaluation. Experiments show that, on the evaluated tasks, policies trained on simulator-generated demonstrations achieve performance comparable to those trained on an equal amount of real-world data, while policy evaluation results in the simulator correlate strongly with real-world robot performance.

讲者简介:
汪怡暄,英伟达西雅图机器人实验室研究科学家,获哥伦比亚大学计算机科学博士学位,师从李昀烛教授。本科毕业于密西根大学和上海交通大学,硕士毕业于伊利诺伊大学厄巴纳香槟分校。研究关注如何利用基础模型实现机器人与环境的交互,以及如何从机器人交互中学习和构建基础模型。相关研究曾获 ICRA 最佳会议论文奖、多个workshop最佳论文奖,并入围 CoRL 最佳论文奖;曾入围高通创新奖学金finalist。

Yixuan Wang is a Research Scientist at NVIDIA’s Seattle Robotics Lab. He received his Ph.D. in Computer Science from Columbia University, advised by Prof. Yunzhu Li, his M.S. from the University of Illinois Urbana-Champaign, and his B.S. degrees from the University of Michigan and Shanghai Jiao Tong University. His research focuses on using foundation models for robotic interaction and building foundation models from robotic interactions. His work has received the ICRA Best Conference Paper Award and multiple workshop Best Paper Awards, and has been selected as a CoRL Best Paper Award finalist. He was also a Qualcomm Innovation Fellowship finalist.

讲者主页:https://www.yixuanwang.me/

报告嘉宾:郝策 北京中关村学院

报告时间:2026年10月15日 早上09:30-10:00(北京时间)

报告题目:

迈向通用具身智能:机器人操作与腿足运动中的学习范式

Towards General-Purpose Embodied Intelligence: Learning Paradigms for Robotic Manipulation and Legged Locomotion

报告摘要:

让机器人能够灵巧地操作物体,并在复杂动态环境中实现稳健运动,是迈向通用具身智能的两项核心挑战。本报告将围绕机器人操作与腿足运动两条研究主线,介绍讲者近年来在机器人学习领域的研究进展。在机器人操作方面,重点讨论基于扩散模型(Diffusion Policy)、视觉-语言-动作模型(VLA)及力觉/触觉反馈的策略学习方法,并介绍通过技能抽象与混合专家模型(Mixture-of-Experts)实现长时序、多任务操作的方法。在腿足运动方面,将介绍面向四足与人形机器人的动态环境感知、反射式避障与运动控制研究。最后,报告将探讨机器人操作与运动控制在感知、决策和学习机制上的共性挑战,并展望面向通用具身智能的统一学习范式。

Enabling robots to manipulate objects dexterously and move robustly in complex, dynamic environments represents two fundamental challenges toward general-purpose embodied intelligence. This talk presents our recent research on robot learning along two complementary directions: robotic manipulation and legged locomotion. For robotic manipulation, we discuss policy learning approaches based on diffusion models (Diffusion Policy), vision-language-action (VLA) models, and force/tactile feedback, as well as skill abstraction and mixture-of-experts architectures for long-horizon and multi-task manipulation. For legged locomotion, we introduce our research on dynamic environment perception, reflexive obstacle avoidance, and motion control for quadrupedal and humanoid robots. Finally, we discuss the shared challenges of robotic manipulation and locomotion in perception, decision-making, and learning, and explore future directions toward unified learning paradigms for general-purpose embodied intelligence.

讲者简介:
郝策,北京中关村学院研究员,博士毕业于新加坡国立大学计算机学院,师从 Harold Soh 教授。此前曾在加州大学伯克利分校 Masayoshi Tomizuka 教授课题组从事研究,本科及硕士毕业于北京航空航天大学。研究方向为具身智能与机器人学习,重点关注基于生成式模型的机器人操作策略、视觉-语言-动作模型、多模态感知与技能学习,以及四足和人形机器人的动态运动控制。相关研究成果发表于 ICRA、CoRL、NeurIPS、ICLR、IEEE RA-L 等国际顶级学术会议及期刊,累计发表论文30余篇。

Ce Hao is a Researcher at Zhongguancun Academy. He received his Ph.D. in Computer Science from the National University of Singapore, advised by Prof. Harold Soh. Prior to that, he conducted research at the University of California, Berkeley, under the supervision of Prof. Masayoshi Tomizuka. He received his B.S. and M.S. degrees from Beihang University. His research focuses on embodied intelligence and robot learning, particularly generative policies for robotic manipulation, vision-language-action models, multimodal perception, skill learning, and dynamic locomotion control for quadrupedal and humanoid robots. He has published over 30 papers in leading robotics and artificial intelligence conferences and journals, including ICRA, CoRL, NeurIPS, ICLR, and IEEE RA-L.

讲者主页:https://cehao1.github.io/


主持人简介:

叶琦,浙江大学控制科学与工程学院“百人计划”研究员,博士生导师。于英国帝国理工学院获得博士学位,随后加入英国剑桥微软研究院Mixed Reality & AI Lab,从事三维人体重建和跟踪、混合现实相关工作。她的研究兴趣集中在计算机视觉、计算机图形学、机器人的交叉方向,包括手物交互下感知、高自由度机械手操作、自主场景感知。在Science Robotics、TRO、IJRR、TPAMI、CVPR/ICCV/ECCV、NeurIPS/ICLR、ICRA/IROS等计算机视觉领域和机器人顶级期刊和会议中发表70余篇论文,多篇录用为oral/splotlight论文,并荣获IEEE RAL25最佳论文荣誉提名奖。担任了3DV2026的出版主席,IEEE RAL编委,CVPR, ICRA、3DV等多次领域主席。

You may also like...