Menglei Chai

Menglei Chai

Research Scientist

AR Perception, Google Inc.

Bio

I am a Research Scientist at Google AR Perception.
I was a Lead Research Scientist in the Creative Vision group at Snap Research.
I got my Ph.D. degree from the Graphics & Parallel Systems Lab (GAPS), Zhejiang University in 2017, supervised by Professor Kun Zhou.
My research interests lie at the intersection between Computer Vision and Computer Graphics, especially human digitization, image manipulation, 3D acquisition, and physics-based animation.

I am looking for self-motivated interns in CV&CG. Drop me an email if you are interested.

Interests

  • Human Digitization
  • Image Manipulation
  • 3D Reconstruction
  • Physics-Based Animation

Education

  • PhD in Computer Science, 2017

    Zhejiang University

  • BSc in Computer Science, 2011

    Zhejiang University

Publications

GroomCap: High-Fidelity Prior-Free Hair Capture

ACM Transactions on Graphics (SIGGRAPH Asia) 2024

Yuxiao Zhou, Menglei Chai, Daoye Wang, Sebastian Winberg, Erroll Wood, Kripasindhu Sarkar, Markus Gross, Thabo Beeler
PDF

MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space

European Conference on Computer Vision (ECCV) 2024

Armand Comas, Di Qiu, Menglei Chai, Marcel Buehler, Amit Raj, Ruiqi Gao, Qiangeng Xu, Mark Matthews, Paulo Gotardo, Sergio Orts-Escolano, Thabo Beeler
PDF

MVDD: Multi-View Depth Diffusion Models

European Conference on Computer Vision (ECCV) 2024

Zhen Wang, Qiangeng Xu, Feitong Tan, Menglei Chai, Shichen Liu, Rohit Pandey, Sean Fanello, Achuta Kadambi, Yinda Zhang
PDF

Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLM

Arxiv 2024

Can Wang, Hongliang Zhong, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
PDF

Efficient 3D Articulated Human Generation with Layered Surface Volumes

International Conference on 3D Vision (3DV) 2024

Yinghao Xu, Yifan Wang, Alexander W. Bergman, Menglei Chai, Bolei Zhou, Gordon Wetzstein
PDF

GroomGen: A High-Quality Generative Hair Model Using Hierarchical Latent Representations

ACM Transactions on Graphics (SIGGRAPH Asia) 2023

Yuxiao Zhou, Menglei Chai, Alessandro Pepe, Markus Gross, Thabo Beeler
PDF Video

AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control

IEEE/CVF International Conference on Computer Vision (ICCV) 2023

Ruixiang Jiang, Can Wang, Jingbo Zhang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
PDF

InfiniCity: Infinite-Scale City Synthesis

IEEE/CVF International Conference on Computer Vision (ICCV) 2023

Chieh Hubert Lin, Hsin-Ying Lee, Willi Menapace, Menglei Chai, Aliaksandr Siarohin, Ming-Hsuan Yang, Sergey Tulyakov
PDF

Efficient Learning of Mesh-Based Physical Simulation with Bi-Stride Multi-Scale Graph Neural Network

International Conference on Machine Learning (ICML) 2023

Yadi Cao, Menglei Chai, Minchen Li, Chenfanfu Jiang
PDF

DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesis

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023

Yinghao Xu, Menglei Chai, Zifan Shi, Sida Peng, Ivan Skorokhodov, Aliaksandr Siarohin, Ceyuan Yang, Yujun Shen, Hsin-Ying Lee, Bolei Zhou, Sergey Tulyakov
PDF Video

3DAvatarGAN: Bridging Domains for Personalized Editable Avatars

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023

Rameen Abdal, Hsin-Ying Lee, Peihao Zhu, Menglei Chai, Aliaksandr Siarohin, Peter Wonka, Sergey Tulyakov
PDF

Unsupervised Volumetric Animation

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023

Aliaksandr Siarohin, Willi Menapace, Ivan Skorokhodov, Kyle Olszewski, Jian Ren, Hsin-Ying Lee, Menglei Chai, Sergey Tulyakov
PDF

Invertible Neural Skinning

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023

Yash Kant, Aliaksandr Siarohin, Riza Alp Guler, Menglei Chai, Sergey Tulyakov, Igor Gilitschenski
PDF

NeRF-Art: Text-Driven Neural Radiance Fields Stylization

IEEE Transactions on Visualization and Computer Graphics (TVCG) 2023

Can Wang, Ruixiang Jiang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
PDF Video

Semantic Probability Distribution Modeling for Diverse Semantic Image Synthesis

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2022

Zhentao Tan, Qi Chu, Menglei Chai, Dongdong Chen, Jing Liao, Qiankun Liu, Bin Liu, Gang Hua, Nenghai Yu
PDF

Cross-Modal 3D Shape Generation and Manipulation

European Conference on Computer Vision (ECCV) 2022

Zezhou Cheng, Menglei Chai, Jian Ren, Hsin-Ying Lee, Kyle Olszewski, Zeng Huang, Subhransu Maji, Sergey Tulyakov
PDF

R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis

European Conference on Computer Vision (ECCV) 2022

Huan Wang, Jian Ren, Zeng Huang, Menglei Chai, Kyle Olszewski, Yun Fu, Sergey Tulyakov
PDF

Quantized GAN for Complex Music Generation from Dance Videos

European Conference on Computer Vision (ECCV) 2022

Ye Zhu, Kyle Olszewski, Yu Wu, Panos Achlioptas, Menglei Chai, Yan Yan, Sergey Tulyakov
PDF

NeROIC: Neural Rendering of Objects from Online Image Collections

ACM Transactions on Graphics (SIGGRAPH) 2022

Zhengfei Kuang, Kyle Olszewski, Menglei Chai, Zeng Huang, Panos Achlioptas, Sergey Tulyakov
PDF Video

CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022

Can Wang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
PDF Video

Cross-Domain and Disentangled Face Manipulation with 3D Guidance

IEEE Transactions on Visualization and Computer Graphics (TVCG) 2022

Can Wang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
PDF Video

DisUnknown: Distilling Unknown Factors for Disentanglement Learning

IEEE/CVF International Conference on Computer Vision (ICCV) 2021

Sitao Xiang, Yuming Gu, Pengda Xiang, Menglei Chai, Hao Li, Yajie Zhao, Mingming He
PDF

Efficient Semantic Image Synthesis via Class-Adaptive Normalization

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2021

Zhentao Tan, Dongdong Chen, Qi Chu, Menglei Chai, Jing Liao, Mingming He, Lu Yuan, Gang Hua, Nenghai Yu
PDF

Diverse Semantic Image Synthesis via Probability Distribution Modeling

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021

Zhentao Tan, Menglei Chai, Dongdong Chen, Jing Liao, Qi Chu, Bin Liu, Gang Hua, Nenghai Yu
PDF

Flow Guided Transformable Bottleneck Networks for Motion Retargeting

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021

Jian Ren, Menglei Chai, Oliver Woodford, Kyle Olszewski, Sergey Tulyakov
PDF

Motion Representations for Articulated Animation

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021

Aliaksandr Siarohin, Oliver Woodford, Jian Ren, Menglei Chai, Sergey Tulyakov
PDF

A Good Image Generator Is What You Need for High-Resolution Video Synthesis

International Conference on Learning Representations (ICLR) 2021

Yu Tian, Jian Ren, Menglei Chai, Kyle Olszewski, Xi Peng, Dimitris N. Metaxas, Sergey Tulyakov
PDF

Exemplar-Based 3D Portrait Stylization

IEEE Transactions on Visualization and Computer Graphics (TVCG) 2021

Fangzhou Han, Shuquan Ye, Mingming He, Menglei Chai, Jing Liao
PDF Video

FaceBlit: Instant Real-Time Example-Based Style Transfer to Facial Videos

ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (i3D) 2021

Aneta Texler, Ondrej Texler, Michal Kucera, Menglei Chai, Daniel Sykora
PDF Video

Neural Hair Rendering

European Conference on Computer Vision (ECCV) 2020

Menglei Chai, Jian Ren, Sergey Tulyakov
PDF Video

MichiGAN: Multi-Input-Conditioned Hair Image Generation for Portrait Editing

ACM Transactions on Graphics (SIGGRAPH) 2020

Zhentao Tan, Menglei Chai, Dongdong Chen, Jing Liao, Qi Chu, Lu Yuan, Sergey Tulyakov, Nenghai Yu
PDF Video

Interactive Video Stylization Using Few-Shot Patch-Based Training

ACM Transactions on Graphics (SIGGRAPH) 2020

Ondrej Texler, David Futschik, Michal Kucera, Ondrej Jamriska, Sarka Sochorova, Menglei Chai, Sergey Tulyakov, Daniel Sykora
PDF Video

Revisiting Image Aesthetic Assessment via Self-Supervised Feature Learning

AAAI Conference on Artificial Intelligence (AAAI) 2020

Kekai Sheng, Weiming Dong, Menglei Chai, Guohui Wang, Peng Zhou, Feiyue Huang, Bao-Gang Hu, Rongrong Ji, Chongyang Ma
PDF

Real-Time Hair Simulation with Neural Interpolation

IEEE Transactions on Visualization and Computer Graphics (TVCG) 2020

Qing Lyu, Menglei Chai, Xiang Chen, Kun Zhou
PDF Video

Human Motion Transfer from Poses in the Wild

European Conference on Computer Vision Workshops (ECCVW) 2020

Jian Ren, Menglei Chai, Sergey Tulyakov, Chen Fang, Xiaohui Shen, Jianchao Yang
PDF

Learning to Assess Visual Aesthetics of Food Images

Computational Visual Media (CVM) 2020

Kekai Sheng, Weiming Dong, Haibin Huang, Menglei Chai, Yong Zhang, Chongyang Ma, Bao-Gang Hu
PDF

End-to-End Time-Lapse Video Synthesis from a Single Outdoor Image

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2019

Seonghyeon Nam, Chongyang Ma, Menglei Chai, William Brendel, Ning Xu, Seon Joo Kim
PDF Video

Real-Time Patch-Based Stylization of Portraits Using Generative Adversarial Network

ACM/EG Expressive 2019

David Futschik, Menglei Chai, Chen Cao, Chongyang Ma, Aleksei Stoliar, Sergey Korolev, Sergey Tulyakov, Michal Kučera, Daniel Sýkora
PDF Video

Stabilized Real-Time Face Tracking via a Learned Dynamic Rigidity Prior

ACM Transactions on Graphics (SIGGRAPH Asia) 2018

Chen Cao, Menglei Chai, Oliver Woodford, Linjie Luo
PDF Video

Parametric Weight-Change Reshaping for Portrait Images

IEEE Computer Graphics and Applications (CG&A) 2018

Haiming Zhao, Xiaogang Jin, Xiaojian Huang, Menglei Chai, Kun Zhou
PDF Video

A Data-Driven Approach to Four-View Image-Based Hair Modeling

ACM Transactions on Graphics (SIGGRAPH) 2017

Meng Zhang, Menglei Chai, Hongzhi Wu, Hao Yang, Kun Zhou
PDF Video

AutoHair: Fully Automatic Hair Modeling from a Single Image

ACM Transactions on Graphics (SIGGRAPH) 2016

Menglei Chai, Tianjia Shao, Hongzhi Wu, Yanlin Weng, Kun Zhou
PDF Video

Adaptive Skinning for Interactive Hair-Solid Simulation

IEEE Transactions on Visualization and Computer Graphics (TVCG) 2016

Menglei Chai, Changxi Zheng, Kun Zhou
PDF Video

High-Quality Hair Modeling from a Single Portrait Photo

ACM Transactions on Graphics (SIGGRAPH Asia) 2015

Menglei Chai, Linjie Luo, Kalyan Sunkavalli, Nathan Carr, Sunil Hadap, Kun Zhou
PDF Video

A Reduced Model for Interactive Hairs

ACM Transactions on Graphics (SIGGRAPH) 2014

Menglei Chai, Changxi Zheng, Kun Zhou
PDF Video

Cone Tracing for Furry Object Rendering

IEEE Transactions on Visualization and Computer Graphics (TVCG) 2014

Hao Qin, Menglei Chai, Qiming Hou, Zhong Ren, Kun Zhou
PDF Video

Dynamic Hair Manipulation in Images and Videos

ACM Transactions on Graphics (SIGGRAPH) 2013

Menglei Chai, Lvdi Wang, Yanlin Weng, Xiaogang Jin, Kun Zhou
PDF Video

As-Rigid-As-Possible Distance Field Metamorphosis

Computer Graphics Forum (Pacific Graphics) 2013

Yanlin Weng, Menglei Chai, Weiwei Xu, Yiying Tong, Kun Zhou
PDF Video

Hair Interpolation for Portrait Morphing

Computer Graphics Forum (Pacific Graphics) 2013

Yanlin Weng, Lvdi Wang, Xiao Li, Menglei Chai, Kun Zhou
PDF Video

Single-View Hair Modeling for Portrait Manipulation

ACM Transactions on Graphics (SIGGRAPH) 2012

Menglei Chai, Lvdi Wang, Yanlin Weng, Yizhou Yu, Baining Guo, Kun Zhou
PDF Video