Biography

I am currently a final Year Ph.D. student (2020.11 - Now), working in Perceiving Systems, Max Planck Institute for Intelligent Systems (MPI-IS), with Michael J. Black and Dimitrios Tzionas. As a Marie Sklodowska-Curie Fellow (MSCA) of CLIPE (ESR 11), I work on Democratizing Human-centric Digitization in computer vision, computer graphics and machine learning.

I was briefly enrolled (2019.9-2020.10) as a Ph.D. student in Vision and Graphics Lab at University of Southern California, advised by Hao Li. I got M.Sc. degree at Shanghai Jiao Tong University in 2019, working in Machine Vision and Intelligence Group, advised by Cewu Lu, and got B.Eng. degree in Digital Media Technology at Shandong University in 2016, worked closely with Lu Wang.

I spent wonderful time at USC Institute for Creative Technology with Jun Xing, at Kwai Y-tech with Chongyang Ma, at LightChaser Animation Studio with Xinxin Zhang, and at Ubisoft La Forge. I will intern at Meta Reality Lab next summer with Shunsuke Saito.

News

[2023/11/23] I will intern at Reality Lab @ Meta next summer with Shunsuke Saito, see you at Pittsburgh!
[2023/11/13] NEW"Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization" comes out, see BOFT.
[2023/11/09] Invited talk "Democratizing Human Digitization" at Westlake University [Slides]
[2023/10/24] NEW"Ghost on the Shell: An Expressive Representation of General 3D Shapes" comes out, see G-Shell.
[2023/10/16] Both TeCH and TADA get accepted by 3DV 2024.
[2023/08-09] Invited talks "Human Digitization from Pixels and Tokens" at Google Research, Cornell, Tsinghua IIIS, and IDEA
[2023/08/21] "TADA! Text to Animatable Digital Avatars" comes out, see TADA.
[2023/08/17] "TeCH: Text-guided Reconstruction of Lifelike Clothed Humans" comes out, see TeCH.
[2023/07/14] "D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field" (ICCV 2023), see D-IF.
[2023/01-06] Invited Talk (30 min) "Towards Large-scale Human Digitization: Implicit or Explicit?" (slides, 75MB) at industry (Taichi, Shanghai AI Lab, BIGAI, Huawei) and academia (PKU, CUHK, UCLA, ETH Zurich, SDU, CAS).
---- show more ----

Publications

Representative works are highlighted
Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization 

Weiyang Liu*, Zeju Qiu*, Yao Feng†, Yuliang Xiu†, Yuxuan Xue†, Longhui Yu†,
Haiwen Feng, Zhen Liu, Juyeon Heo, Songyou Peng, Yandong Wen,
Michael J. Black, Adrian Weller, Bernhard Schölkopf
(* equal first author, † equal second author, alphabetical order)
arXiv 2023
Intro  Home  Paper [arXiv, Reader] Bibtex 
Ghost on the Shell: An Expressive Representation of General 3D Shapes 

Zhen Liu, Yao Feng†, Yuliang Xiu†, Weiyang Liu, Liam Paull Michael J. Black, Bernhard Schölkopf
(† equal second author, alphabetical order)
arXiv 2023
Intro  Home  Paper [arXiv, Reader] Bibtex 
TeCH: Text-guided Reconstruction of Lifelike Clothed Humans 

Yangyi Huang*, Yuliang Xiu*, Hongwei Yi*, Tingting Liao, Jiaxiang Tang, Deng Cai, Justus Thies
(*equal contribution)
International Conference on 3D Vision 2024 (3DV 2024)
Intro  Home  Video[En, Paper [arXiv, Reader] Bibtex 
TADA! Text to Animatable Digital Avatars 

Tingting Liao*, Hongwei Yi*, Yuliang Xiu, Jiaxiang Tang, Yangyi Huang, Justus Thies, Michael J. Black
(*equal contribution)
International Conference on 3D Vision 2024 (3DV 2024)
Intro  Home  Paper [arXiv, Reader] Video[En, Bibtex 
D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field 

Xueting Yang*, Yihao Luo*, Yuliang Xiu, Wei Wang, Hao Xu, Zhaoxin Fan
(*equal contribution)
International Conference on Computer Vision 2023 (ICCV 2023)
Intro  Home  Paper [arXiv, Reader] Bibtex 
ECON: Explicit Clothed humans Optimized via Normal integration 
Google Colab

Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, Michael J. Black
Computer Vision and Pattern Recognition 2023 (CVPR 2023, Highlight)
Intro  Home  Paper [arXiv, Reader] Video [En, ]  Zhihu  Bibtex 
High-Fidelity Clothed Avatar Reconstruction from a Single Image  

Tingting Liao, Xiaomei Zhang, Yuliang Xiu, Hongwei Yi, ..., Xiangyu Zhu, Zhen Lei
Computer Vision and Pattern Recognition 2023 (CVPR 2023)
Intro  Home  Paper [arXiv, Reader] Bibtex 
AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time 

Hao-shu Fang*, Jiefeng Li*, Hongyang Tang, Chao Xu, Haoyi Zhu, Yuliang Xiu, Yong-lu Li, Cewu Lu
(*equal contribution)
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2022)
Intro  Home  Paper [arXiv, Reader] Video  Bibtex 
DART: Articulated Hand Model with Diverse Accessories and Rich Textures 

Daiheng Gao*, Yuliang Xiu*, Kailin Li*, Lixin Yang*,..., Cewu Lu, Ping Tan
(*equal contribution)
Neural Information Processing Systems (NeurIPS 2022 -Datasets and Benchmarks Track)
Intro  Home  Paper [arXiv, Reader] Video  Bibtex 
ICON: Implicit Clothed humans Obtained from Normals 
Google Colab

Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, Michael J. Black
Computer Vision and Pattern Recognition 2022 (CVPR 2022)
Intro  Home  Paper [arXiv, Reader] Slides  Video [En, ]  Zhihu  Bibtex 
Monocular Real-Time Volumetric Performance Capture 

Ruilong Li*, Yuliang Xiu*, Shunsuke Saito, Zeng Huang, Kyle Olszewski, Hao Li
(*equal contribution)
European Conference on Computer Vision (ECCV 2020)
Intro  Home  Paper [arXiv , Reader] Video   Zhihu  Bibtex  
Volumetric Human Teleportation 

Ruilong Li, Kyle Olszewski, Yuliang Xiu, Shunsuke Saito, Zeng Huang, Hao Li
SIGGRAPH Real-Time Live 2020 (Best in Show Award)
Intro  Home  Paper [PDF , Reader] Video   Media ( 1, 2, 3, 4)Bibtex  
Pose Flow: Efficient Online Pose Tracking 

Yuliang Xiu, Jiefeng Li, Haoyu Wang, Yinghong Fang, Cewu Lu
British Machine Vision Conference (BMVC 2018)
Intro  Paper [arXiv , Reader]  Zhihu  Bibtex  

Mentoring

I am fortunate to (co-)mentor a few talented and highly motivated junior students and senior engineer (alphabetical order):

Invited Talks

Academic Service

Blogs


This page is last updated at