![]() |
|
BiographyI am currently a final Year Ph.D. student (2020.11 - Now), working in Perceiving Systems, Max Planck Institute for Intelligent Systems (MPI-IS), with Michael J. Black and Dimitrios Tzionas. As a Marie Sklodowska-Curie Fellow (MSCA) of CLIPE (ESR 11), I work on Democratizing Human-centric Digitization in computer vision, computer graphics and machine learning.I spent wonderful time at USC Institute for Creative Technology with Jun Xing, at Kwai Y-tech with Chongyang Ma, at LightChaser Animation Studio with Xinxin Zhang, and at Ubisoft La Forge. I will intern at Meta Reality Lab next summer with Shunsuke Saito. |
News
[2023/11/23] I will intern at Reality Lab @ Meta next summer with Shunsuke Saito, see you at Pittsburgh![2023/11/13] NEW"Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization" comes out, see BOFT.
[2023/11/09] Invited talk "Democratizing Human Digitization" at Westlake University [Slides]
[2023/10/24] NEW"Ghost on the Shell: An Expressive Representation of General 3D Shapes" comes out, see G-Shell.
[2023/10/16] Both TeCH and TADA get accepted by 3DV 2024.
[2023/08-09] Invited talks "Human Digitization from Pixels and Tokens" at Google Research, Cornell, Tsinghua IIIS, and IDEA
[2023/08/21] "TADA! Text to Animatable Digital Avatars" comes out, see TADA.
[2023/08/17] "TeCH: Text-guided Reconstruction of Lifelike Clothed Humans" comes out, see TeCH.
[2023/07/14] "D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field" (ICCV 2023), see D-IF.
[2023/01-06] Invited Talk (30 min) "Towards Large-scale Human Digitization: Implicit or Explicit?" (slides, 75MB) at industry (Taichi, Shanghai AI Lab, BIGAI, Huawei) and academia (PKU, CUHK, UCLA, ETH Zurich, SDU, CAS).
---- show more ----
Publications
Representative works are highlighted
![]() |
Parameter-Efficient Orthogonal Finetuning via Butterfly
Factorization
Weiyang Liu*, Zeju Qiu*, Yao Feng†, Yuliang Xiu†, Yuxuan Xue†, Longhui Yu†, Haiwen Feng, Zhen Liu, Juyeon Heo, Songyou Peng, Yandong Wen, Michael J. Black, Adrian Weller, Bernhard Schölkopf (* equal first author, † equal second author, alphabetical order)
arXiv 2023
Intro
Home
Paper [arXiv,
Reader]
Bibtex
|
![]() |
Ghost on the Shell: An Expressive Representation of General 3D
Shapes
Zhen Liu, Yao Feng†, Yuliang Xiu†, Weiyang Liu, Liam Paull Michael J. Black, Bernhard Schölkopf († equal second author, alphabetical order)
arXiv 2023
Intro
Home
Paper [arXiv,
Reader]
Bibtex
|
TeCH: Text-guided Reconstruction of Lifelike Clothed
Humans
Yangyi Huang*, Yuliang Xiu*, Hongwei Yi*, Tingting Liao, Jiaxiang Tang, Deng Cai, Justus Thies (*equal contribution)
International Conference on 3D Vision 2024 (3DV 2024)
Intro
Home
Video[En,
中]
Paper [arXiv,
Reader]
Bibtex
|
|
TADA! Text to Animatable Digital Avatars
Tingting Liao*, Hongwei Yi*, Yuliang Xiu, Jiaxiang Tang, Yangyi Huang, Justus Thies, Michael J. Black (*equal contribution)
International Conference on 3D Vision 2024 (3DV 2024)
Intro
Home
Paper [arXiv,
Reader]
Video[En,
中]
Bibtex
|
|
![]() |
D-IF: Uncertainty-aware Human Digitization via Implicit
Distribution Field
Xueting Yang*, Yihao Luo*, Yuliang Xiu, Wei Wang, Hao Xu, Zhaoxin Fan (*equal contribution)
International Conference on Computer Vision 2023 (ICCV 2023)
Intro
Home
Paper [arXiv,
Reader]
Bibtex
|
![]() |
ECON: Explicit Clothed humans Optimized via Normal
integration ![]() ![]() ![]() Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, Michael J. Black
Computer Vision and Pattern Recognition 2023 (CVPR 2023, Highlight)
Intro
Home
Paper [arXiv,
Reader]
Video [En,
中]
Zhihu
Bibtex
|
![]() |
High-Fidelity Clothed Avatar Reconstruction from a Single Image
Tingting Liao, Xiaomei Zhang, Yuliang Xiu, Hongwei Yi, ..., Xiangyu Zhu, Zhen Lei
Computer Vision and Pattern Recognition 2023 (CVPR 2023)
Intro
Home
Paper [arXiv,
Reader]
Bibtex
|
![]() |
AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and
Tracking in Real-Time
Hao-shu Fang*, Jiefeng Li*, Hongyang Tang, Chao Xu, Haoyi Zhu, Yuliang Xiu, Yong-lu Li, Cewu Lu (*equal contribution)
IEEE Transactions on Pattern Analysis and Machine
Intelligence (TPAMI 2022)
Intro
Home
Paper [arXiv,
Reader]
Video
Bibtex
|
DART: Articulated Hand Model with Diverse Accessories and Rich
Textures
Daiheng Gao*, Yuliang Xiu*, Kailin Li*, Lixin Yang*,..., Cewu Lu, Ping Tan (*equal contribution)
Neural Information Processing Systems (NeurIPS 2022
-Datasets and Benchmarks Track)
Intro
Home
Paper [arXiv,
Reader]
Video
Bibtex
|
|
![]() |
ICON: Implicit Clothed humans Obtained from Normals
![]() ![]() Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, Michael J. Black
Computer Vision and Pattern Recognition 2022 (CVPR 2022)
Intro
Home
Paper [arXiv,
Reader]
Slides
Video [En,
中]
Zhihu
Bibtex
|
![]() |
Monocular Real-Time Volumetric Performance Capture Ruilong Li*, Yuliang Xiu*, Shunsuke Saito, Zeng Huang, Kyle Olszewski, Hao Li (*equal contribution)
European Conference on Computer Vision (ECCV 2020)
Intro
Home
Paper [arXiv ,
Reader]
Video
Zhihu
Bibtex
|
![]() |
Volumetric Human Teleportation Ruilong Li, Kyle Olszewski, Yuliang Xiu, Shunsuke Saito, Zeng Huang, Hao Li
SIGGRAPH Real-Time Live 2020 (Best in Show Award)
Intro
Home
Paper [PDF , Reader]
Video
Media (
1,
2,
3,
4)
Bibtex
|
![]() |
Pose Flow: Efficient Online Pose Tracking Yuliang Xiu, Jiefeng Li, Haoyu Wang, Yinghong Fang, Cewu Lu
British Machine Vision Conference (BMVC 2018)
Intro
Paper [arXiv ,
Reader]
Zhihu
Bibtex
|
Mentoring
I am fortunate to (co-)mentor a few talented and highly motivated junior students and senior engineer (alphabetical order):- Yangyi Huang (2023-Now): TeCH (3DV'24)
-
Tingting Liao (2022-Now)
: CAR (CVPR'23), TADA
(3DV'24)
- Master at Chinese Academy of Sciences
- → Ph.D. at MBZUAI with Dr. Hao Li, congrats! 🎉
-
Daiheng Gao (2022-Now)
: DART (NeurIPS'22)
- Senior algorithm engineer in XR Lab at Alibaba
-
Xueting Yang (2023-Now) :
D-IF (ICCV'23)
- Undergrad at Communication University of China
- → Ph.D. at The University of Hong Kong with Dr. Kenneth K.Y. Wong, congrats! 🎉
Invited Talks
- Democratizing Human Digitization [slides (122MB)]
- Westlake University, hosted by Xiaofei Li
- Zhejiang University, hosted by Jianwei Yin
- Human Digitization from Pixels and Tokens
- Google Research, hosted by Thiemo Alldieck
- Cornell University, hosted by Ruolin Ye
- Tsinghua University, Institute for Interdisciplinary Information Sciences (IIIS), hosted by Li Yi
- International Digital Economy Academy (IDEA), Computer Vision and Robotics, hosted by Ailing Zeng
-
Towards Large-scale Human Digitization: Implicit or Explicit?
[slides (75MB),
Video (30 min)]
Taichi, PKU, CUHK, UCLA, ETH Zurich, SDU, CAS, Shanghai AI Lab, BIGAI, Huawei
- Taichi Graphics(太极大讲堂), hosted by Tiantian Liu and Qing Yan
- Huawei (CG&XR武林大会), hosted by Shiqi Zhou
- Huawei (稼先社区&藤蔓技术论坛), hosted by Tao Bai
- ETH Zurich, Photogrammetry and Remote Sensing Lab, hosted by Shengyu Huang
- BIGAI, Beijing Institute for General Artifical Intelligence, hosted by Yixin Chen
- Shanghai AI Laboratory, Content Generation and Digitization Group, hosted by Bo Dai
- UCLA, Multi-Physics Lagrangian-Eulerian Simulations (MultiPLES) Laboratory, hosted by Ziyin Qu
- Shandong University, Interdisciplinary Research Center & Taishan College, hosted by Haisen Zhao
- Shandong University, Research Center of Human-Computer Interaction and Virtual Reality, hosted by Lu Wang
- CUHK, The Chinese University of Hong Kong (Shenzhen), GAP Lab, hosted by Xiaoguang Han
- ICT CAS, Institute of Computing Technology, Chinese Academy of Sciences, hosted by Lin Gao and Jie Yang
- Peking University, the School of Artificial Intelligence, hosted by Siyan Dong and Baoquan Chen
- 如何多快好省地重建三维数字人 [ TechBeat (40 min)]
- 走进马克思普朗克智能系统研究所与苏黎世联邦理工AIT团队 [ Part A (2h), Part B (2h)]
- ICON: 提高三维数字人重建的姿势水平 [Keynote (726MB), Video (60 min)]
- Talking Papers Podcast: ICON [Link]
-
Towards Large-scale Avatar Creation From In-the-wild
Pixels
[slides, 25MB]
Meta, USC, OPPO, Tecent, Adobe
- Meta Reality Labs, Pittsburgh, hosted by Shunsuke Saito and Giljoo Nam
- USC-ICT, USC Institute for Creative Technology, hosted by Yajie Zhao
- Adobe, Digital Humans Seminar, hosted by Yi Zhou
- OPPO, US Research Center, hosted by Xudong Liu and Guojun Qi
- Tecent, GY-Lab(光影研究室), hosted by Chao Xu and Gang Yu
-
Pose trajectory extraction and novel-view synthesis from visual
content
[Link]
- Max Planck Institute for Intelligent Systems, hosted by Siyu Tang
Westlake, ZJU
Google Research, Cornell, Tsinghua, IDEA
Academic Service
- Computer Graphics (CG): SIGGRAPH (2022, 2023), SIGGRAPH Asia (2023), Eurographics (2024), TVCG (2024)
- Computer Vision (CV): CVPR (2022, 2023), ECCV (2022), ICCV (2023), NeurIPS (2023), 3DV (2024), T-PAMI (2021)
Blogs
- [论文详解]CVPR'23 (Highlight) | ECON: 一个数字人,显式隐式各自表述
- [论文详解]CVPR 2022 | ICON: 提高三维数字人重建的姿势水平
- [翻译]当我们谈科学研究的创新性时,我们在谈些什么 Source 译文
This page is last updated at