GAMES Webinar 2020 – 160期(绘制专题) | Yezi Zhao(Shandong University), Jie Guo(Nanjing University)
【GAMES Webinar 2020-160期】(绘制专题)
报告嘉宾1:Yezi Zhao(Shandong University)
报告时间:2020年10月29号星期四晚上8:00-8:45(北京时间)
报告题目:Joint SVBRDF Recovery and Synthesis From a Single Image using an Unsupervised Generative Adversarial Network
报告摘要:
We want to recreate spatially-varying bi-directional reflectance distribution functions (SVBRDFs) from a single image. Producing these SVBRDFs from single images will allow designers to incorporate many new materials in their virtual scenes, increasing their realism. Existing algorithms can produce high-quality SVBRDFs with single or few input photographs using supervised deep learning. The learning step relies on a huge dataset with both input photographs and the ground truth SVBRDF maps. This is a weakness as ground truth maps are not easy to acquire. For practical use, it is also important to produce large SVBRDF maps. Existing algorithms rely on a separate texture synthesis step to generate these large maps, which leads to the loss of consistency between generated SVBRDF maps. In this paper, we address both issues simultaneously. We present an unsupervised generative adversarial neural network that addresses both SVBRDF capture from a single image and synthesis at the same time. From a low-resolution input image, we generate a large resolution SVBRDF, much larger than the input images. We train a generative adversarial network (GAN) to get SVBRDF maps, which have both a large spatial extent and detailed texels. Each input for our method requires individual training, which costs about 3 hours.
讲者简介:
赵烨梓,2018年于山东大学软件学院获得学士学位,现为山东大学软件学院硕士三年级研究生,导师为王璐教授和徐延宁副教授。主要研究兴趣包括真实感绘制和材质建模。本讲座汇报论文在南京理工大学王贝贝教授的共同指导下完成。
报告嘉宾2:Jie Guo (Nanjing University)
报告时间:2020年10月29号星期四晚上8:45-9:30(北京时间)
报告题目:DeepBRDF: A Deep Representation for Manipulating Measured BRDF
报告摘要:
Effective compression of densely sampled BRDF measurements is critical for many graphical or vision applications. In this paper, we present DeepBRDF, a deep-learning-based representation that can significantly reduce the dimensionality of measured BRDFs while enjoying high quality of recovery. We consider each measured BRDF as a sequence of image slices and design a deep autoencoder with a masked L2 loss to discover a nonlinear low-dimensional latent space of the high-dimensional input data. Thorough experiments verify that the proposed method clearly outperforms PCA-based strategies in BRDF data compression and is more robust. We demonstrate the effectiveness of DeepBRDF with two applications. For BRDF editing, we can easily create a new BRDF by navigating on the low-dimensional manifold of DeepBRDF, guaranteeing smooth transitions and high physical plausibility. For BRDF recovery, we design another deep neural network to automatically generate the full BRDF data from a single input image. Aided by our DeepBRDF learned from real-world materials, a wide range of reflectance behaviors can be recovered with high accuracy.
讲者简介:
Jie Guo is currently an assistant professor at the State Key Lab for Novel Software Technology, Nanjing University. He received his doctoral degree in department of computer science and technology from Nanjing University in 2013. His research interests include physically-based rendering, appearance modeling and virtual reality.
讲者个人主页: http://118.25.137.210/
主持人简介:
吴鸿智,浙江大学计算机科学与技术学院副教授、博士生导师,国家优秀青年基金获得者。本科毕业于复旦大学,博士毕业于美国耶鲁大学。主要研究兴趣为高密度采集装备与可微分建模,研制了多套具有自主知识产权的高密度光源阵列采集装备,发表了10余篇CCF-A类期刊论文。担任Chinagraph程序秘书长,中国图像图形学会智能图形专委会委员,以及PG、EGSR、CAD/Graphics等多个国际会议的程序委员会委员。主持人个人主页:http://www.cad.zju.edu.cn/home/hwu/
GAMES主页的“使用教程”中有 “如何观看GAMES Webinar直播?”及“如何加入GAMES微信群?”的信息;
GAMES主页的“资源分享”有往届的直播讲座的视频及PPT等。
观看直播的链接:http://webinar.games-cn.org