I am currently a 3rd-Year CS Ph.D. student, working in Perceiving Systems, Max Planck Institute for Intelligent Systems, with Michael J. Black.

As a Marie Sklodowska-Curie Fellow (MSCA), my Ph.D. topic is Image/video-based holistic modeling for the animation of body, face, hands, feet, clothing, and interaction (ESR 11), which is part of the CLIPE initiative and funded by the European Union’s Horizon 2020 Research and Innovation Programme.

I was briefly enrolled (2019-2020) as a Ph.D. student in Vision and Graphics Lab at University of Southern California before I decided to relocate at Tuebingen, advised by Hao Li (Now the CEO and Co-founder of Pinscreen). I got M.Sc. degree at Shanghai Jiao Tong University in 2019, working in Machine Vision and Intelligence Group, advised by Cewu Lu, and got B.Eng. degree in Digital Media Technology at Shandong University in 2016, worked closely with Lu Wang.

I also spent wonderful time at USC Institute for Creative Technology with Shunsuke Saito (Now the research scientist at Meta Reality Lab) and Jun Xing (Now the lead researcher of miHoYo), at Kwai Y-tech Graphics AI Team with Chongyang Ma, at LightChaser Animation Studio with Xinxin Zhang (Now the co-founder and CTO of Zenus), and worked as R&D intern at Ubisoft La Forge.

As a Virtual Avatar Researcher, I am focused on exploring the realms of pixels and voxels. My primary research interests revolve around the nexus of computer vision and computer graphics, particularly in relation to 3D human digitization (including reconstruction, modeling, and animation) and the estimation and tracking of 2D human poses.


[2023/01-06] Invited Talk (30 min) "Towards Large-scale Human Digitization: Implicit or Explicit?" (slides, 75MB) at industry (Taichi, Shanghai AI Lab, BIGAI, Huawei) and academia (PKU, CUHK, UCLA, ETH Zurich, SDU, CAS).
[2023/04/23] ECON won Outstanding Poster (4/80) in China 3DV.
[2023/04/16] Now both and Google Colab are available for ECON users!
[2023/03/21] ECON has been selected as CVPR highlight papers (10% of accepted papers, 2.5% of submissions).
[2023/03/15] 💕 I'm thrilled to announce that Cathy and I are finally tying the knot! 💍 Love Moment
[2023/02/27] ECON and CAR got accepted by CVPR 2023
[2023/02/13] NYTimes"See How Kansas City Secured Its Comeback", ICON for Super Bowl 2023!
[2023/01/12] Multiple contributors support Windows, Docker, Blender andGoogle Colab for ECON, bravo!
[2022/12/20] NYTimes"Modeling Key World Cup Moments with Machine Learning", ICON for World Cup 2022!
---- show more ----


Favorite papers are highlighted.
ECON: Explicit Clothed humans Optimized via Normal integration 

Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, Michael J. Black
Computer Vision and Pattern Recognition 2023 (CVPR 2023, Highlight)

Intro  Home  [arXiv, Reader] Video [En, ] Bibtex 
High-Fidelity Clothed Avatar Reconstruction from a Single Image  

Tingting Liao, Xiaomei Zhang, Yuliang Xiu, Hongwei Yi, Xudong Liu, Guo-Jun Qi, Yong Zhang, Xuan Wang, Xiangyu Zhu, Zhen Lei
Computer Vision and Pattern Recognition 2023 (CVPR 2023)

Intro  Home  [arXiv, Reader] Bibtex 
AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time 

Hao-shu Fang*, Jiefeng Li*, Hongyang Tang, Chao Xu, Haoyi Zhu, Yuliang Xiu, Yong-lu Li, Cewu Lu,
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2022)

Intro  Home  [arXiv, Reader] Video  Bibtex 
DART: Articulated Hand Model with Diverse Accessories and Rich Textures 

Daiheng Gao*, Yuliang Xiu*, Kailin Li*, Lixin Yang*, Feng Wang, Peng Zhang, Bang Zhang, Cewu Lu, Ping Tan
Neural Information Processing Systems (NeurIPS 2022 -Datasets and Benchmarks Track)

Intro  Home  [arXiv, Reader] Video  Bibtex 
ICON: Implicit Clothed humans Obtained from Normals 

Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, Michael J. Black
Computer Vision and Pattern Recognition 2022 (CVPR 2022)

Intro  Home  [arXiv, Reader] Slides  Video [En, ]  Zhihu  Bibtex 
Monocular Real-Time Volumetric Performance Capture 

Ruilong Li*, Yuliang Xiu*, Shunsuke Saito, Zeng Huang, Kyle Olszewski, Hao Li
(*equal contribution)
European Conference on Computer Vision (ECCV 2020)

Intro  Home  [arXiv , Reader] Video   Zhihu  Bibtex  
Volumetric Human Teleportation 

Ruilong Li, Kyle Olszewski, Yuliang Xiu, Shunsuke Saito, Zeng Huang, Hao Li
SIGGRAPH Real-Time Live 2020 (Best in Show Award)

Intro  Home  [Paper , Reader] Video   Media ( 1, 2, 3, 4)Bibtex  
Pose Flow: Efficient Online Pose Tracking 

Yuliang Xiu, Jiefeng Li, Haoyu Wang, Yinghong Fang, Cewu Lu
British Machine Vision Conference (BMVC 2018)

Intro  [arXiv , Reader]  Zhihu  Bibtex  


Academic Service


[翻译]当我们谈科学研究的创新性时,我们在谈些什么 Source  译文 

This page is last updated at