![]() |
|
BiographyI am currently a 3rd-Year CS Ph.D. student, working in Perceiving Systems, Max Planck Institute for Intelligent Systems, with Michael J. Black.As a Marie Sklodowska-Curie Fellow (MSCA), my Ph.D. topic is Image/video-based holistic modeling for the animation of body, face, hands, feet, clothing, and interaction (ESR 11), which is part of the CLIPE initiative and funded by the European Union’s Horizon 2020 Research and Innovation Programme. I was briefly enrolled (2019-2020) as a Ph.D. student in Vision and Graphics Lab at University of Southern California before I decided to relocate at Tuebingen, advised by Hao Li (Now the CEO and Co-founder of Pinscreen). I got M.Sc. degree at Shanghai Jiao Tong University in 2019, working in Machine Vision and Intelligence Group, advised by Cewu Lu, and got B.Eng. degree in Digital Media Technology at Shandong University in 2016, worked closely with Lu Wang. I also spent wonderful time at USC Institute for Creative Technology with Shunsuke Saito (Now the research scientist at Meta Reality Lab) and Jun Xing (Now the lead researcher of miHoYo), at Kwai Y-tech Graphics AI Team with Chongyang Ma, at LightChaser Animation Studio with Xinxin Zhang (Now the co-founder and CTO of Zenus), and worked as R&D intern at Ubisoft La Forge. |
As a Virtual Avatar Researcher, I am focused on exploring the realms of pixels and voxels. My primary research interests revolve around the nexus of computer vision and computer graphics, particularly in relation to 3D human digitization (including reconstruction, modeling, and animation) and the estimation and tracking of 2D human poses.
News
[2023/01-06] Invited Talk (30 min) "Towards Large-scale Human Digitization: Implicit or Explicit?" (slides, 75MB) at industry (Taichi, Shanghai AI Lab, BIGAI, Huawei) and academia (PKU, CUHK, UCLA, ETH Zurich, SDU, CAS).[2023/04/23] ECON won Outstanding Poster (4/80) in China 3DV.
[2023/04/16] Now both
[2023/03/21] ECON has been selected as CVPR highlight papers (10% of accepted papers, 2.5% of submissions).
[2023/03/15] 💕 I'm thrilled to announce that Cathy and I are finally tying the knot! 💍 Love Moment
[2023/02/27] ECON and CAR got accepted by CVPR 2023
[2023/02/13] NYTimes"See How Kansas City Secured Its Comeback", ICON for Super Bowl 2023!
[2023/01/12] Multiple contributors support Windows, Docker, Blender andGoogle Colab for ECON, bravo!
[2022/12/20] NYTimes"Modeling Key World Cup Moments with Machine Learning", ICON for World Cup 2022!
---- show more ----
Publications
Favorite papers are
highlighted.
![]() |
ECON: Explicit Clothed humans Optimized via Normal
integration ![]() ![]() ![]() ![]() Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, Michael J. Black Computer Vision and Pattern Recognition 2023 (CVPR 2023, Highlight) Intro Home [arXiv, Reader] Video [En, 中] Bibtex |
![]() |
High-Fidelity Clothed Avatar Reconstruction from a Single Image
Tingting Liao, Xiaomei Zhang, Yuliang Xiu, Hongwei Yi, Xudong Liu, Guo-Jun Qi, Yong Zhang, Xuan Wang, Xiangyu Zhu, Zhen Lei Computer Vision and Pattern Recognition 2023 (CVPR 2023) Intro Home [arXiv, Reader] Bibtex |
![]() |
AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and
Tracking in Real-Time
Hao-shu Fang*, Jiefeng Li*, Hongyang Tang, Chao Xu, Haoyi Zhu, Yuliang Xiu, Yong-lu Li, Cewu Lu, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2022) Intro Home [arXiv, Reader] Video Bibtex |
DART: Articulated Hand Model with Diverse Accessories and Rich
Textures
Daiheng Gao*, Yuliang Xiu*, Kailin Li*, Lixin Yang*, Feng Wang, Peng Zhang, Bang Zhang, Cewu Lu, Ping Tan Neural Information Processing Systems (NeurIPS 2022 -Datasets and Benchmarks Track) Intro Home [arXiv, Reader] Video Bibtex |
|
![]() |
ICON: Implicit Clothed humans Obtained from Normals
![]() Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, Michael J. Black Computer Vision and Pattern Recognition 2022 (CVPR 2022) Intro Home [arXiv, Reader] Slides Video [En, 中] Zhihu Bibtex |
![]() |
Monocular Real-Time Volumetric Performance Capture Ruilong Li*, Yuliang Xiu*, Shunsuke Saito, Zeng Huang, Kyle Olszewski, Hao Li (*equal contribution) European Conference on Computer Vision (ECCV 2020) Intro Home [arXiv , Reader] Video Zhihu Bibtex |
![]() |
Volumetric Human Teleportation Ruilong Li, Kyle Olszewski, Yuliang Xiu, Shunsuke Saito, Zeng Huang, Hao Li SIGGRAPH Real-Time Live 2020 (Best in Show Award) Intro Home [Paper , Reader] Video Media ( 1, 2, 3, 4) Bibtex |
![]() |
Pose Flow: Efficient Online Pose Tracking Yuliang Xiu, Jiefeng Li, Haoyu Wang, Yinghong Fang, Cewu Lu British Machine Vision Conference (BMVC 2018) Intro [arXiv , Reader] Zhihu Bibtex |
Talks
-
Towards Large-scale Human Digitization: Implicit or Explicit?
(slides (75MB),
Video (30 min))
List of talks (Taichi, PKU, CUHK, UCLA, ETH Zurich, SDU, CAS, Shanghai AI Lab, BIGAI, Huawei)
- Taichi Graphics(太极大讲堂), hosted by Tiantian Liu and Qing Yan
- Huawei (CG&XR武林大会), hosted by Shiqi Zhou
- Huawei (稼先社区&藤蔓技术论坛), hosted by Tao Bai
- ETH Zurich, Photogrammetry and Remote Sensing Lab, hosted by Shengyu Huang
- BIGAI, Beijing Institute for General Artifical Intelligence, hosted by Yixin Chen
- Shanghai AI Laboratory, Content Generation and Digitization Group, hosted by Bo Dai
- UCLA, Multi-Physics Lagrangian-Eulerian Simulations (MultiPLES) Laboratory, hosted by Ziyin Qu
- Shandong University, Interdisciplinary Research Center & Taishan College, hosted by Haisen Zhao
- Shandong University, Research Center of Human-Computer Interaction and Virtual Reality, hosted by Lu Wang
- CUHK, The Chinese University of Hong Kong (Shenzhen), GAP Lab, hosted by Xiaoguang Han
- ICT CAS, Institute of Computing Technology, Chinese Academy of Sciences, hosted by Lin Gao and Jie Yang
- Peking University, the School of Artificial Intelligence, hosted by Siyan Dong and Baoquan Chen
- 如何多快好省地重建三维数字人 ( TechBeat (40 min))
- 走进马克思普朗克智能系统研究所与苏黎世联邦理工AIT团队 ( Part A (2h), Part B (2h))
- ICON: 提高三维数字人重建的姿势水平 (Keynote (726MB), Video (60 min))
- Talking Papers Podcast: ICON (Link)
-
Towards Large-scale Avatar Creation From In-the-wild
Pixels
(slides, 25MB)
List of talks (Meta, USC, OPPO, Tecent, Adobe)
- Meta Reality Labs, Pittsburgh, hosted by Shunsuke Saito and Giljoo Nam
- USC-ICT, USC Institute for Creative Technology, hosted by Yajie Zhao
- Adobe, Digital Humans Seminar, hosted by Yi Zhou
- OPPO, US Research Center, hosted by Xudong Liu and Guojun Qi
- Tecent, GY-Lab(光影研究室), hosted by Chao Xu and Gang Yu
-
Pose trajectory extraction and novel-view synthesis from visual
content
(Link)
- Max Planck Institute for Intelligent Systems, hosted by Siyu Tang
Academic Service
- Computer Graphics (CG): SIGGRAPH, SIGGRAPH Asia
- Computer Vision (CV): CVPR, ECCV, ICCV, NeurIPS, T-PAMI
Blogs
[翻译]当我们谈科学研究的创新性时,我们在谈些什么 Source 译文This page is last updated at