Awesome Digital Human

A curated collection of resources on clothed people: full body recontruction, head reconstruction, digital human related projects, etc.

Contributing

Feedback and contributions are welcome! If you think I have missed out on something (or) have any suggestions (papers, implementations and other resources), feel free to pull a request. You could manually edit items or use the script to produce them in the markdown format provided below.

**Here is the Paper Name.**<br>
*[Author 1](homepage), Author 2, and Author 3.*<br>
Conference or Journal Year. [[PDF](link)] [[Project](link)] [[Code](link)] [[Data](link)]

Table of Contents

• Industry Demo or Product
• 3D Human Avatar Generation and Animation
• 3D Head Animatable Avatar (from 2D Image Collections)
• (Clothed) Human Motion Generation
• Clothed Human Digitalization
• Cloth Modelling, Draping, Simulation, and Dressing
• Human Image and Video Generation
• Image-Based Virtual Try-On
• Human Body Reshaping
• Garment Design
• Fashion Style Influences
• Team and People
• Dataset
• Applications

Industry Demo or Product

Highavenue: Turn yourself into a 3D model.

3D Human Avatar Generation and Animation

Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling.
Zhe Li, Zerong Zheng, Lizhen Wang, Yebin Liu..
CVPR 2024. [PDF] [Project] [Code]

HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generation.
Xin Huang, Ruizhi Shao, Qi Zhang, Hongwen Zhang, Ying Feng, Yebin Liu, Qing Wang..
CVPR 2024. [PDF] [Project]

RAM-Avatar: Real-time Photo-Realistic Avatar from Monocular Videos with Full-body Control.
Xiang Deng, Zerong Zheng, Yuxiang Zhang, Jingxiang Sun, Chao Xu, XiaoDong Yang, Lizhen Wang, Yebin Liu.
CVPR 2024. [PDF] [Project]

TexVocab:Texture Vocabulary-conditioned Human Avatars.
Yuxiao Liu, Zhe Li, Yebin Liu, Haoqian Wang.
CVPR 2024. [PDF] [Project]

DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models.
Yukang Cao, Yan-Pei Cao, Kai Han, Ying Shan, Kwan-Yee K. Wong.
CVPR 2024. [PDF] [Project] [Code]

3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting.
Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger, Siyu Tang.
CVPR 2024. [PDF] [Project]

Emotional Speech-driven 3D Body Animation Via Disentangled Latent Diffusion.
Kiran Chhatre, Radek Daněček, Nikos Athanasiou, Giorgio Becherini, Christopher Peters, Michael J. Black, Timo Bolkart.
CVPR 2024. [PDF]

GauHuman: Articulated Gaussian Splatting from Monocular Human Videos.
Shoukang Hu, Ziwei Liu.
CVPR 2024. [PDF] [Project] [Code]

FlashAvatar: High-Fidelity Digital Avatar Rendering at 300FPS.
Jun Xiang, Xuan Gao, Yudong Guo, Juyong Zhang.
CVPR 2024. [PDF] [Project]

TADA! Text to Animatable Digital Avatars.
Tingting Liao, Hongwei Yi, Yuliang Xiu, Jiaxiang Tang, Yangyi Huang, Justus Thies, Michael J. Black.
3DV 2024. [PDF] [Project] [Code]

Efficient 3D Articulated Human Generation with Layered Surface Volumes.
Yinghao Xu, Wang Yifan, Alexander W. Bergman, Menglei Chai, Bolei Zhou, Gordon Wetzstein.
3DV 2024. [PDF] [Project]

TECA: Text-Guided Generation and Editing of Compositional 3D Avatars.
Hao Zhang, Yao Feng, Peter Kulits, Yandong Wen, Justus Thies, Michael J. Black.
3DV 2024. [PDF] [Project]

FLARE: Fast Learning of Animatable and Relightable Mesh Avatars.
Shrisha Bharadwaj, Yufeng Zheng, Otmar Hilliges, Michael J. Black, Victoria Fernandez-Abrevaya.
SIGGRAPH Asia 2023. [PDF]

Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization.
Connor Z. Lin, Koki Nagano, Jan Kautz, Eric R. Chan, Umar Iqbal, Leonidas Guibas, Gordon Wetzstein, Sameh Khamis.
SIGGRAPH 2023. [PDF] [Project] [Code]

DELIFFAS: Deformable Light Fields for Fast Avatar Synthesis.
Youngjoong Kwon, Lingjie Liu, Henry Fuchs, Marc Habermann, Christian Theobalt.
NeurIPS 2023. [PDF]

PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation.
Zhaoxi Chen, Fangzhou Hong, Haiyi Mei, Guangcong Wang, Lei Yang, Ziwei Liu.
NeurIPS 2023. [PDF] [Project] [Code]

XAGen: 3D Expressive Human Avatars Generation.
Zhongcong Xu, Jianfeng Zhang, Jun Hao Liew, Jiashi Feng, Mike Zheng Shou.
NeurIPS 2023. [PDF] [Project] [Code]

DreamHuman: Animatable 3D Avatars from Text.
Nikos Kolotouros, Thiemo Alldieck, Andrei Zanfir, Eduard Gabriel Bazavan, Mihai Fieraru, Cristian Sminchisescu.
NeurIPS 2023. [PDF] [Project] [Avatar Gallery]

DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars.
David Svitov, Dmitrii Gudkov, Renat Bashirov, Victor Lempitsky.
ICCV 2023. [PDF] [Code]

AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control.
Ruixiang Jiang, Can Wang, Jingbo Zhang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao.
ICCV 2023. [PDF] [Project] [Code] [Data]

StyleAvatar3D: Leveraging Image-Text Diffusion Models for High-Fidelity 3D Avatar Generation.
Chi Zhang, Yiwen Chen, Yijun Fu, Zhenglin Zhou, Gang YU, Billzb Wang, Bin Fu, Tao Chen, Guosheng Lin, Chunhua Shen.
ICCV 2023. [PDF] [Project] [Code]

Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priors.
Zhangyang Xiong, Di Kang, Derong Jin, Weikai Chen, Linchao Bao, Xiaoguang Han.
ICCV 2023. [PDF] [Code]

GETAvatar: Generative Textured Meshes for Animatable Human Avatars.
Xuanmeng Zhang, Jianfeng Zhang, Rohan Chacko, Hongyi Xu, Guoxian Song, Yi Yang, Jiashi Feng.
ICCV 2023. [PDF] [Project]

AG3D: Learning to Generate 3D Avatars from 2D Image Collections.
Zijian Dong, Xu Chen, Jinlong Yang, Michael J. Black, Otmar Hilliges, Andreas Geiger.
ICCV 2023. [PDF] [Project] [Code]

Learning Locally Editable Virtual Humans.
Hsuan-I Ho, Lixin Xue, Jie Song, Otmar Hilliges.
CVPR 2023. [PDF] [Project] [Code]

PersonNeRF: Personalized Reconstruction from Photo Collections.
Chung-Yi Weng, Pratul P. Srinivasan, Brian Curless, Ira Kemelmacher-Shlizerman.
CVPR 2023. [PDF] [Project] [Code]

Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures.
Gal Metzer, Elad Richardson, Or Patashnik, Raja Giryes, Daniel Cohen-Or.
CVPR 2023. [PDF] [Code]

EVA3D: Compositional 3D Human Generation from 2D Image Collections.
Fangzhou Hong, Zhaoxi Chen, Yushi Lan, Liang Pan, Ziwei Liu.
ICLR 2023. [PDF] [Project] [Code]

CLIP-Actor: Text-Driven Recommendation and Stylization for Animating Human Meshes.
Kim Youwang, Kim Ji-Yeon, Tae-Hyun Oh.
ECCV 2022. [PDF] [Project] [Code]

AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars.
Fangzhou Hong, Mingyuan Zhang, Liang Pan, Zhongang Cai, Lei Yang, Ziwei Liu.
SIGGRAPH (TOG) 2022. [PDF] [Project] [Code]

InstructHumans: Editing Animated 3D Human Textures with Instructions.
Jiayin Zhu, Linlin Yang, Angela Yao.
arXiv 2023. [PDF]

Relightable Neural Actor with Intrinsic Decomposition and Pose Control.
Diogo Luvizon, Vladislav Golyanik, Adam Kortylewski, Marc Habermann, Christian Theobalt.
arXiv 2023. [PDF] [Project]

Disentangled Clothed Avatar Generation from Text Descriptions.
Jionghao Wang, Yuan Liu, Zhiyang Dou, Zhengming Yu, Yongqing Liang, Xin Li, Wenping Wang, Rong Xie, Li Song.
arXiv 2023. [PDF] [Project]

AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Text.
Jianfeng Zhang, Xuanmeng Zhang, Huichao Zhang, Jun Hao Liew, Chenxu Zhang, Yi Yang, Jiashi Feng.
arXiv 2023. [PDF] [Project]

HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting.
Xian Liu, Xiaohang Zhan, Jiaxiang Tang, Ying Shan, Gang Zeng, Dahua Lin, Xihui Liu, Ziwei Liu.
arXiv 2023. [PDF] [Project]

Drivable 3D Gaussian Avatars.
Wojciech Zielonka, Timur Bagautdinov, Shunsuke Saito, Michael Zollhöfer, Justus Thies, Javier Romero.
arXiv 2023. [PDF] [Project]

MagicAvatar: Multimodal Avatar Generation and Animation.
Jianfeng Zhang, Hanshu Yan, Zhongcong Xu, Jiashi Feng, Jun Hao Liew.
arXiv 2023. [PDF] [Project]

Learning Disentangled Avatars with Hybrid 3D Representations.
Yao Feng, Weiyang Liu, Timo Bolkart, Jinlong Yang, Marc Pollefeys, Michael J. Black.
arXiv 2023. [PDF] [Project] [Code]

SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes.
Soubhik Sanyal, Partha Ghosh, Jinlong Yang, Michael J. Black, Justus Thies, Timo Bolkart.
arXiv 2023. [PDF] [Project]

Guide3D: Create 3D Avatars from Text and Image Guidance.
Yukang Cao, Yan-Pei Cao, Kai Han, Ying Shan, Kwan-Yee K. Wong.
arXiv 2023. [PDF]

AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation.
Yifei Zeng, Yuanxun Lu, Xinya Ji, Yao Yao, Hao Zhu, Xun Cao.
arXiv 2023. [PDF] [Project] [Code]

3D Head Animatable Avatar (from 2D Image Collections)

Gaussian Head Avatar: Ultra High-fidelity Head Avatar via Dynamic Gaussians.
Yuelang Xu, Benwang Chen, Zhe Li, Hongwen Zhang, Lizhen Wang, Zerong Zheng, Yebin Liu.
CVPR 2024. [PDF] [Project]

HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillation.
Hongyu Liu, Xuan Wang, Ziyu Wan, Yujun Shen, Yibing Song, Jing Liao, Qifeng Chen.
SIGGRAPH 2024. [PDF] [Project]

GAN-Avatar: Controllable Personalized GAN-based Human Head Avatar.
Berna Kabadayi, Wojciech Zielonka, Bharat Lal Bhatnagar, Gerard Pons-Moll, Justus Thies.
3DV 2024. [PDF] [Project]

NeRFEditor: Differentiable Style Decomposition for Full 3D Scene Editing.
Chunyi Sun, Yanbin Liu, Junlin Han, Stephen Gould.
WACV 2024. [PDF] [Project]

AlbedoGAN: Towards Realistic Generative 3D Face Models.
Aashish Rai, Hiresh Gupta, Ayush Pandey, Francisco Vicente Carrasco, Shingo Jason Takagi, Amaury Aubel, Daeil Kim, Aayush Prakash, Fernando de la Torre.
WACV 2024. [PDF] [Project] [Code]

AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars.
Mohit Mendiratta. Xingang Pan, Mohamed Elgharib, Kartik Teotia, Mallikarjun B R, Ayush Tewari, Vladislav Golyanik, Adam Kortylewski, Christian Theobalt.
TOG 2024. [PDF] [Project]

HQ3DAvatar: High Quality Controllable 3D Head Avatar.
Kartik Teotia, Mallikarjun B R, Xingang Pan, Hyeongwoo Kim, Pablo Garrido, Mohamed Elgharib, Christian Theobalt.
TOG 20234. [PDF] [Project] [Code]

CLIPFace: Text-guided Editing of Textured 3D Morphable Models.
Shivangi Aneja, Justus Thies, Angela Dai, Matthias Nießner.
SIGGRAPH 2023. [PDF] [Project] [Code]

DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidance.
Longwen Zhang, Qiwei Qiu, Hongyang Lin, Qixuan Zhang, Cheng Shi, Wei Yang, Ye Shi, Sibei Yang, Lan Xu, Jingyi Yu.
SIGGRAPH 2023. [PDF] [Project] [Demo] [HuggingFace]

StyleAvatar: Real-time Photo-realistic Neural Portrait Avatar from a Single Video.
Lizhen Wang, Xiaochen Zhao, Jingxiang Sun, Yuxiang Zhang, Hongwen Zhang, Tao Yu✝, Yebin Liu.
SIGGRAPH 2023. [PDF]

LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatar.
Yuelang Xu, Hongwen Zhang, Lizhen Wang, Xiaochen Zhao, Han Huang, Guojun Qi, Yebin Liu.
SIGGRAPH 2023. [PDF], [Project],[Code]

NeRSemble: Multi-view Radiance Field Reconstruction of Human Heads.
Tobias Kirschstein, Shenhan Qian, Simon Giebenhain, Tim Walter, Matthias Nießner.
SIGGRAPH 2023. [PDF] [Project] [Video]

GOHA: Generalizable One-shot Neural Head Avatar.
Xueting Li, Shalini De Mello, Sifei Liu, Koki Nagano, Umar Iqbal, Jan Kautz.
NeurIPS 2023. [PDF] [Project]

GANHead: Towards Generative Animatable Neural Head Avatars.
[Sijing Wu]((https://wsj-sjtu.github.io), Yichao Yan, Yunhao Li, Yuhao Cheng, Wenhan Zhu, Ke Gao, Xiaobo Li, Guangtao Zhai.
CVPR 2023. [PDF] [Project]

FitMe: Deep Photorealistic 3D Morphable Model Avatars.
Alexandros Lattas, Stylianos Moschoglou, Stylianos Ploumpis, Baris Gecer, Jiankang Deng, Stefanos Zafeiriou.
CVPR 2023. [PDF] [Project]

Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars.
Jingxiang Sun, Xuan Wang, Lizhen Wang, Xiaoyu Li, Yong Zhang, Hongwen Zhang, Yebin Liu.
CVPR 2023 (Highlight). [PDF] [Project] [Code]

BlendFields: Few-Shot Example-Driven Facial Modeling.
Kacper Kania, Stephan J. Garbin, Andrea Tagliasacchi, Virginia Estellers, Kwang Moo Yi, Julien Valentin, Tomasz Trzciński, Marek Kowalski.
CVPR 2023. [PDF] [Project]

OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Rendering.
Zhiyuan Ma, Xiangyu Zhu, Guojun Qi, Zhen Lei, Lei Zhang.
CVPR 2023. [PDF] [Code] [Demo]

PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360∘.
Sizhe An, Hongyi Xu, Yichun Shi, Guoxian Song, Umit Ogras, Linjie Luo.
CVPR 2023. [PDF [Project]

Efficient Meshy Neural Fields for Animatable Human Avatars.
Xiaoke Huang, Yiji Cheng, Yansong Tang, Xiu Li, Jie Zhou, Jiwen Lu .
CVPR 2023. [PDF] [Project]

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion.
Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, Baining Guo.
CVPR 2023. [PDF] [Project]

OmniAvatar: Geometry-Guided Controllable 3D Head Synthesis.
Hongyi Xu, Guoxian Song, Zihang Jiang, Jianfeng Zhang, Yichun Shi, Jing Liu, Wanchun Ma, Jiashi Feng, Linjie Luo.
CVPR 2023. [PDF]

PointAvatar: Deformable Point-based Head Avatars from Videos.
Yufeng Zheng, Wang Yifan, Gordon Wetzstein, Michael J. Black, Otmar Hilliges.
CVPR 2023. [PDF] [Project] [Code]

MEGANE: Morphable Eyeglass and Avatar Network.
Junxuan Li, Shunsuke Saito, Tomas Simon, Stephen Lombardi, Hongdong Li, Jason Saragih.
CVPR 2023. [PDF] [Project]

Reconstructing Personalized Semantic Facial NeRF Models From Monocular Video.
Xuan Gao, ChengLai Zhong, Jun Xiang, Yang Hong, Yudong Guo, Juyong Zhang.
TOG 2022. [PDF] [Project] [Code]

H3D-Net: Few-Shot High-Fidelity 3D Head Reconstruction.
Eduard Ramon, Gil Triginer, Janna Escur, Albert Pumarola, Jaime Garcia, Xavier Giro-i-Nieto, Francesc Moreno-Noguer.
ICCV 2021. [PDF] [Project] [H3DS Dataset]

AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANs.
Alexandros Lattas, Stylianos Moschoglou, Stylianos Ploumpis, Baris Gecer, Abhijeet Ghosh, Stefanos Zafeiriou.
TPAMI 2021. [PDF] [Code]

AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild".
Alexandros Lattas, Stylianos Moschoglou, Baris Gecer, Stylianos Ploumpis, Vasileios Triantafyllou, Abhijeet Ghosh, Stefanos Zafeiriou.
CVPR 2020. [PDF] [Code]

(Clothed) Human Motion Generation

HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion.
Mustafa Işık, Martin Rünz, Markos Georgopoulos, Taras Khakhulin, Jonathan Starck, Lourdes Agapito, Matthias Nießner.
SIGGRAPH 2023. [PDF] [Project] [Code] [Data]

GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latents.
Tenglong Ao, Zeyi Zhang, Libin Liu.
SIGGRAPH 2023 (Journal Track). [PDF] [Project] [Code]

MDM: Human Motion Diffusion Model.
Guy Tevet, Sigal Raab, Brian Gordon, Yonatan Shafir, Daniel Cohen-Or, Amit H. Bermano.
ICLR 2023. [PDF] [Project] [Code]

MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis.
Rishabh Dabral, Muhammad Hamza Mughal, Vladislav Golyanik, Christian Theobalt.
CVPR 2023. [PDF] [Project]

MotionCLIP: Exposing Human Motion Generation to CLIP Space.
Guy Tevet, Brian Gordon, Amir Hertz, Amit H. Bermano, Daniel Cohen-Or.
ECCV 2022. [PDF] [Project] [Code]

TEMOS: Generating diverse human motions from textual descriptions.
Mathis Petrovich, Michael J. Black, Gül Varol.
ECCV 2022. [PDF] [Project] [Code]

TEACH: Temporal Action Composition for 3D Human.
Nikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül Varol.
3DV 2022. [PDF] [Project] [Code]

TLControl: Trajectory and Language Control for Human Motion Synthesis.
Weilin Wan, Zhiyang Dou, Taku Komura, Wenping Wang, Dinesh Jayaraman, Lingjie Liu.
arXiv 2023. [PDF]

OmniControl: Control Any Joint at Any Time for Human Motion Generation.
Yiming Xie, Varun Jampani, Lei Zhong, Deqing Sun, Huaizu Jiang.
arXiv 2023. [PDF] [Project]

Total Selfie: Generating Full-Body Selfies.
Bowei Chen, Brian Curless, Ira Kemelmacher-Shlizerman, Steve Seitz.
arXiv 2023. [PDF] [Project]

TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis.
Mathis Petrovich, Michael J. Black and Gül Varol.
arXiv 2023. [PDF] [Project] [Code]

SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation.
Nikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül Varol.
arXiv 2023. [PDF] [Project] [Code]

MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model.
Mingyuan Zhang, Zhongang Cai, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, Ziwei Liu.
arXiv 2022. [PDF] [Project] [Code]

Clothed Human Digitalization

Project Splinter: Human Digitalization with Implicit Representation.

IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos Via Explicit Ray Tracing.
Shaofei Wang, Božidar Antić, Andreas Geiger, Siyu Tang.
CVPR 2024. [PDF] [Project]

GaussianAvatar: Towards Realistic Human Avatar Modeling from A Single Video Via Animatable 3D Gaussians.
Liangxiao Hu, Hongwen Zhang, Yuxiang Zhang, Boyao Zhou, Boning Liu, Shengping Zhang, Liqiang Nie.
CVPR 2024. [PDF] [Project] [Github]

SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion.
Hsuan-I Ho, Jie Song, Otmar Hilliges.
CVPR 2024. [PDF] [Project]

Recovering 3D Human Mesh from Monocular Images: A Survey.
Yating Tian, Hongwen Zhang, Yebin Liu, Limin Wang.
TPAMI 2023. [PDF] [Project] [Dataset] [Benchmarks]

Mirror-Aware Neural Humans.
Daniel Ajisafe, James Tang, Shih-Yang Su, Bastian Wandt, Helge Rhodin.
3DV 2024. [PDF] [Project]

TeCH: Text-guided Reconstruction of Lifelike Clothed Humans.
Yangyi Huang, Hongwei Yi, Yuliang Xiu, Tingting Liao, Jiaxiang Tang, Deng Cai, Justus Thies.
3DV 2024. [PDF] [Project]

Single-Image 3D Human Digitization with Shape-Guided Diffusion.
Badour AlBahar, Shunsuke Saito, Hung-Yu Tseng, Changil Kim, Johannes Kopf, Jia-Bin Huang.
SIGGRAPH Asia 2023. [PDF] [Project]

Global-correlated 3D-decoupling Transformer for Clothed Avatar Reconstruction.
Zechuan Zhang, Li Sun, Zongxin Yang, Ling Chen, Yi Yang.
NeurIPS 2023. [PDF]

ISP: Multi-Layered Garment Draping with Implicit Sewing Patterns.
Ren Li, Benoît Guillard, Pascal Fua.
NeurIPS 2023. [PDF]

NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objects.
Taeksoo Kim, Shunsuke Saito, Hanbyul Joo.
ICCV 2023. [PDF] [Project]

Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models.
Byungjun Kim, Patrick Kwon, Kwangho Lee, Myunggi Lee, Sookwan Han, Daesik Kim, Hanbyul Joo.
ICCV 2023 (Oral). [PDF] [Project]

SHERF: Generalizable Human NeRF from a Single Image.
Shoukang Hu, Fangzhou Hong, Liang Pan, Haiyi Mei, Lei Yang, Ziwei Liu.
ICCV 2023. [PDF] [Project] [Code]

SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling.
Zhitao Yang, Zhongang Cai, Haiyi Mei, Shuai Liu, Zhaoxi Chen, Weiye Xiao, Yukun Wei, Zhongfei Qing, Chen Wei, Bo Dai, Wayne Wu, Chen Qian, Dahua Lin, Ziwei Liu, Lei Yang.
ICCV 2023. [PDF] [Project]

Cyclic Test-Time Adaptation on Monocular Video for 3D Human Mesh Reconstruction.
Hyeongjin Nam, Daniel Sungho Jung, Yeonguk Oh, Kyoung Mu Lee.
ICCV 2023. [PDF]

HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion.
Mustafa Işık, Martin Rünz, Markos Georgopoulos, Taras Khakhulin, Jonathan Starck, Lourdes Agapito, Matthias Nießner.
SIGGRAPH 2023. [PDF] [Project] [Code] [Data]

AvatarReX: Real-time Expressive Full-body Avatars.
Zerong Zheng, Xiaochen Zhao, Hongwen Zhang, Boning Liu, Yebin Liu.
SIGGRAPH 2023 [PDF] [Project]

PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modeling.
Zhe Li, Zerong Zheng, Yuxiao Liu, Boyao Zhou, Yebin Liu.
SIGGRAPH 2023 [PDF] [Project]

High-Fidelity Clothed Avatar Reconstruction from a Single Image.
Tingting Liao, Xiaomei Zhang, Yuliang Xiu, Hongwei Yi, Xudong Liu, Guo-Jun Qi, Yong Zhang, Xuan Wang, Xiangyu Zhu, Zhen Lei.
CVPR 2023. [PDF] [Code]

SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstruction.
Yukang Cao, Kai Han, Kenneth Kwan-Yee K. Wong.
CVPR 2023. [PDF] [Project] [Code]

Structured 3D Features for Reconstructing Relightable and Animatable Avatars.
Enric Corona, Mihai Zanfir, Thiemo Alldieck, Eduard Gabriel Bazavan, Andrei Zanfir, Cristian Sminchisescu.
CVPR 2023. [PDF] [Project]

Reconstructing Animatable Categories from Videos.
Gengshan Yang, Chaoyang Wang, N Dinesh Reddy, Deva Ramanan.
CVPR 2023. [PDF] [Project] [Code]

Representing Volumetric Videos as Dynamic MLP Maps.
Sida Peng, Yunzhi Yan, Qing Shuai, Hujun Bao, Xiaowei Zhou.
CVPR 2023. [PDF] [Project] [Code]

Learning Neural Volumetric Representations of Dynamic Humans in Minutes.
Chen Geng, Sida Peng, Zhen Xu, Hujun Bao, Xiaowei Zhou.
CVPR 2023. [PDF] [Project] [Code]

CloSET: Modeling Clothed Humans on Continuous Surface with Explicit Template Decomposition.
Hongwen Zhang, Siyou Lin, Ruizhi Shao, Yuxiang Zhang, Zerong Zheng, Han Huang, Yandong Guo, Yebin Liu.
CVPR 2023. [PDF] [Project]

MonoHuman: Animatable Human Neural Field from Monocular Video.
Zhengming Yu, Wei Cheng, Xian Liu, Wayne Wu, Kwan-Yee Lin.
CVPR 2023. [PDF] [Project]

FlexNeRF: Photorealistic Free-viewpoint Rendering of Moving Humans from Sparse Views.
Vinoj Jayasundara, Amit Agrawal, Nicolas Heron, Abhinav Shrivastava, Larry S. Davis.
CVPR 2023. [PDF]

High-fidelity 3D Human Digitization from Single 2K Resolution Images.
Sang-Hun Han, Min-Gyu Park, Ju Hong Yoon, Ju-Mi Kang, Young-Jae Park, Hae-Gon Jeon.
CVPR 2023 (Highlight). [PDF] [Code]

Learning Neural Volumetric Representations of Dynamic Humans in Minutes.
Chen Geng, Sida Peng, Zhen Xu, Hujun Bao, Xiaowei Zhou.
CVPR 2023. [PDF] [Project]

Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition.
Chen Guo, Tianjian Jiang, Xu Chen, Jie Song, Otmar Hilliges.
CVPR 2023. [PDF] [Project]

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion.
Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, Baining Guo.
CVPR 2023. [PDF] [Project]

ECON: Explicit Clothed humans Obtained from Normals.
Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, Michael J. Black.
CVPR 2023. [PDF] [Project] [Code]

X-Avatar: Expressive Human Avatars.
Kaiyue Shen, Chen Guo, Manuel Kaufmann, Juan Jose Zarate, Julien Valentin, Jie Song, Otmar Hilliges.
CVPR 2023. [PDF] [Project] [Code]

InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds.
Tianjian Jiang, Xu Chen, Jie Song, Otmar Hilliges.
CVPR 2022. [PDF] [Project] [Code]

Learning Visibility Field for Detailed 3D Human Reconstruction and Relighting.
Ruichen Zheng, Peng Li, Haoqian Wang, Tao Yu.
CVPR 2023. [PDF]

HumanGen: Generating Human Radiance Fields with Explicit Priors.
Suyi Jiang, Haoran Jiang, Ziyu Wang, Haimin Luo, Wenzheng Chen, Lan Xu.
CVPR 2023. [PDF]

SHARP: Shape-Aware Reconstruction of People In Loose Clothing.
Sai Sagar Jinka, Rohan Chacko, Astitva Srivastava, Avinash Sharma, P.J. Narayanan.
IJCV 2023. [PDF]

Geometry-aware Two-scale PIFu Representation for Human Reconstruction.
Zheng Dong, Ke Xu, Ziheng Duan, Hujun Bao, Weiwei Xu, Rynson W.H. Lau.
NeurIPS 2022. [PDF]

TotalSelfScan: Learning Full-body Avatars from Self-Portrait Videos of Faces, Hands, and Bodies.
Junting Dong, Qi Fang, Yudong Guo, Sida Peng, Qing Shuai, Hujun Bao, Xiaowei Zhou.
NeurIPS 2022. [PDF] [Data]

FOF: Learning Fourier Occupancy Field for Monocular Real-time Human Reconstruction.
Qiao Feng, Yebin Liu, Yu-Kun Lai, Jingyu Yang, Kun Li.
NeurIPS 2022. [PDF] [Project] [Code]

Dual-Space NeRF: Learning Animatable Avatars and Scene Lighting in Separate Spaces Yihao Zhi, Shenhan Qian, Xinhao Yan, Shenghua Gao 3DV 2022. [PDF] [Code]

Neural Point-based Shape Modeling of Humans in Challenging Clothing.
Qianli Ma, Jinlong Yang, Michael J. Black, Siyu Tang.
3DV 2022. [PDF]

HVTR: Hybrid Volumetric-Textural Rendering for Human Avatars.
Tao Hu, Tao Yu, Zerong Zheng, He Zhang, Yebin Liu, Matthias Zwicker.
3DV 2022. [PDF] [Project]

Human Performance Modeling and Rendering via Neural Animated Mesh.
Fuqiang Zhao, Yuheng Jiang, Kaixin Yao, Jiakai Zhang, Liao Wang, Haizhao Dai, Yuhui Zhong, Yingliang Zhang, Minye Wu, Lan Xu, Jingyi Yu.
SIGGRAPH Asia 2022. [PDF] [Project]

FloRen: Real-time High-quality Human Performance Rendering via Appearance Flow Using Sparse RGB Cameras.
Ruizhi Shao, Liliang Chen, Zerong Zheng, Hongwen Zhang, Yuxiang Zhang, Han Huang, Yandong Guo, Yebin Liu.
SIGGRAPH Asia 2022. [PDF]

Occupancy Planes for Single-view RGB-D Human Reconstruction.
Xiaoming Zhao, Yuan-Ting Hu, Zhongzheng Ren, Alexander G. Schwing.
AAAI 2023. [PDF] [Code]

HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modeling.
Zhongang Cai, Daxuan Ren, Ailing Zeng, Zhengyu Lin, Tao Yu, Wenjia Wang, Xiangyu Fan, Yang Gao, Yifan Yu, Liang Pan, Fangzhou Hong, Mingyuan Zhang, Chen Change Loy, Lei Yang, Ziwei Liu.
ECCV 2022 (Oral). [PDF] [Project]

Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representations.
Atsuhiro Noguchi, Xiao Sun, Stephen Lin, Tatsuya Harada.
ECCV 2022. [PDF] [Project] [Code]

NeuMan: Neural Human Radiance Field from a Single Video.
Wei Jiang, Kwang Moo Yi, Golnoosh Samei, Oncel Tuzel, Anurag Ranjan.
ECCV 2022. [PDF] [Code]

ARAH: Animatable Volume Rendering of Articulated Human SDFs.
Shaofei Wang, Katja Schwarz, Andreas Geiger, Siyu Tang.
ECCV 2022. [PDF] [Project] [Code]

DiffuStereo: High Quality Human Reconstruction via Diffusion-based Stereo Using Sparse Cameras.
Ruizhi Shao, Zerong Zheng, Hongwen Zhang, Jingxiang Sun, Yebin Liu.
ECCV (Oral) 2022. [PDF] [Code]

LoRD: Local 4D Implicit Representation for High-Fidelity Dynamic Human Modeling.
Boyan Jiang, Xinlin Ren, Mingsong Dou, Xiangyang Xue, Yanwei Fu, Yinda Zhang.
ECCV 2022. [PDF] [Code]

Neural Capture of Animatable 3D Human from Monocular Video.
Gusi Te, Xiu Li, Xiao Li, Jinglu Wang, Wei Hu, Yan Lu.
ECCV 2022. [PDF]

The One Where They Reconstructed 3D Humans and Environments in TV Shows.
Georgios Pavlakos, Ethan Weber, Matthew Tancik, Angjoo Kanazawa.
ECCV 2022. [PDF] [Project]

UNIF: United Neural Implicit Functions for Clothed Human Reconstruction and Animation.
Shenhan Qian, Jiale Xu, Ziwei Liu, Liqian Ma, Shenghua Gao.
ECCV 2022. [PDF]

3D Clothed Human Reconstruction in the Wild.
Gyeongsik Moon, Hyeongjin Nam, Takaaki Shiratori, Kyoung Mu Lee.
ECCV 2022. [PDF] [Project]

NDF: Neural Deformable Fields for Dynamic Human Modelling.
Ruiqi Zhang, Jie Chen.
ECCV 2022. [PDF]

Animatable Volume Rendering of Articulated Human SDFs.
Shaofei Wang, Katja Schwarz, Andreas Geiger, Siyu Tang.
ECCV 2022. [PDF] [Project] [Project]

Learning Implicit Templates for Point-Based Clothed Human Modeling.
Siyou Lin, Hongwen Zhang, Zerong Zheng, Ruizhi Shao, Yebin Liu.
ECCV 2022. [PDF] [Project] [Project]

DANBO: Disentangled Articulated Neural Body Representations via Graph Neural Networks.
Shih-Yang Su, Timur Bagautdinov, and Helge Rhodin.
ECCV 2022. [PDF] [Project] [Code]

Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering.
Mingfei Chen, Jianfeng Zhang, Xiangyu Xu, Lijuan Liu, Jiashi Feng, Shuicheng Yan.
ECCV 2022. [PDF]

AvatarCap: Animatable Avatar Conditioned Monocular Human Volumetric Capture.
Zhe Li, Zerong Zheng, Hongwen Zhang, Chaonan Ji, Yebin Liu.
ECCV 2022. [PDF] [Project]

Authentic Volumetric Avatars From a Phone Scan.
Chen Cao, Tomas Simon, Jin Kyu Kim, Gabe Schwartz, Michael Zollhoefer, Shunsuke Saito, Stephen Lombardi, Shih-en Wei, Danielle Belko, Shoou-i Yu, Yaser Sheikh, Jason Saragih.
SIGGRAPH 2022. [PDF] [Project]

HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputs.
Fuqiang Zhao, Wei Yang, Jiakai Zhang, Pei Lin, Yingliang Zhang, Jingyi Yu, Lan Xu.
CVPR 2022. [PDF] [Project]

Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothing.
Thiemo Alldieck, Mihai Zanfir, Cristian Sminchisescu.
CVPR 2022. [PDF] [Project]

HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video.
Chung-Yi Weng, Brian Curless, Pratul Srinivasan,Jonathan T. Barron, Ira Kemelmacher-Shlizerman.
CVPR 2022. [PDF] [Project]

H4D: Human 4D Modeling by Learning Neural Compositional Representation.
Boyan Jiang, Yinda Zhang, Xingkui Wei, Xiangyang Xue, Yanwei Fu.
CVPR 2022. [PDF]

OcclusionFusion: Occlusion-aware Motion Estimation for Real-time Dynamic 3D Reconstruction.
Wenbin Lin, Chengwei Zheng, Jun-Hai Yong, Feng Xu.
CVPR 2022. [PDF] [Project]

PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequence.
Zijian Dong, Chen Guo, Jie Song, Xu Chen, Andreas Geiger, Otmar Hilliges.
CVPR 2022. [PDF] [Project]

SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Video.
Boyi Jiang, Yang Hong, Hujun Bao, Juyong Zhang.
CVPR 2022. [PDF] [Project]

Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-time.
Liao Wang, Jiakai Zhang, Xinhang Liu, Fuqiang Zhao, Yanshun Zhang, Yingliang Zhang, Minye Wu, Lan Xu, Jingyi Yu.
CVPR 2022. [PDF]

NeuralHOFusion: Neural Volumetric Rendering under Human-object Interactions.
Yuheng Jiang, Suyi Jiang, Guoxing Sun, Zhuo Su, Kaiwen Guo, Minye Wu, Jingyi Yu, Lan Xu.
CVPR 2022. [PDF] [Project]

JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstruction.
Yukang Cao, Guanying Chen, Kai Han, Wenqi Yang, Kwan-Yee K. Wong.
CVPR 2022 (oral). [PDF] [Project]

High-Fidelity Human Avatars from a Single RGB Camera.
Hao Zhao, Jinsong Zhang, Yu-Kun Lai, Zerong Zheng, Yingdi Xie, Yebin Liu, Kun Li.
CVPR 2022. [PDF] [Project] [Project] [Data]

ICON: Implicit Clothed humans Obtained from Normals.
Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, Michael J. Black.
CVPR 2022. [PDF] [Code]

DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Rendering.
Ruizhi Shao, Hongwen Zhang, He Zhang, Yanpei Cao, Tao Yu, Yebin Liu.
CVPR 2022. [PDF] [Project]

Structured Local Radiance Fields for Human Avatar Modeling.
Zerong Zheng, Han Huang, Tao Yu, Hongwen Zhang, Yandong Guo, Yebin Liu.
CVPR 2022. [PDF] [Project] [Code]

DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and Rendering.
Ruizhi Shao, Hongwen Zhang, He Zhang, Mingjia Chen, Yanpei Cao, Tao Yu, Yebin Liu.
CVPR 2022. [PDF] [Project]

I M Avatar: Implicit Morphable Head Avatars from Videos.
Yufeng Zheng, Victoria Fernández Abrevaya, Xu Chen, Marcel C. Bühler, Michael J. Black, Otmar Hilliges.
CVPR 2022. [PDF]

Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesis.
Tianhan Xu, Yasuhiro Fujita, Eiichi Matsumoto.
CVPR 2022. [PDF]

Neural Head Avatars from Monocular RGB Videos.
Philip-William Grassal, Malte Prinzler, Titus Leistner, Carsten Rother, Matthias Nießner, Justus Thies.
CVPR 2022. [PDF] [Project]

gDNA: Towards Generative Detailed Neural Avatars.
Xu Chen, Tianjian Jiang, Jie Song, Jinlong Yang, Michael J. Black, Andreas Geiger, Otmar Hilliges.
CVPR 2022. [PDF] [Project] [Code]

HumanNeRF: Generalizable Neural Human Radiance Field from Sparse Inputs.
Fuqiang Zhao, Wei Yang, Jiakai Zhang, Pei Lin, Yingliang Zhang, Jingyi Yu, Lan Xu.
CVPR 2022. [PDF] [Project]

PERGAMO: Personalized 3D Garments from Monocular Video.
Andrés Casado-Elvira, Marc Comino Trinidad, Dan Casas.
CFG 2022. [PDF] [Project]

Explicit Clothing Modeling for an Animatable Full-Body Avatar.
Donglai Xiang, Fabian Andres Prada, Timur Bagautdinov, Weipeng Xu, Yuan Dong, He Wen, Jessica Hodgins, Chenglei Wu.
SIGGRAPH Asia 2021. [PDF]

Driving-Signal Aware Full-Body Avatars.
Timur Bagautdinov, Chenglei Wu, Tomas Simon, Fabian Prada, Takaaki Shiratori, Shih-En Wei, Weipeng Xu, Yaser Sheikh, Jason Saragih.
TOG 2021. [PDF]

High-Fidelity 3D Digital Human Head Creation from RGB-D Selfies.
Xiangkai Lin, Yajing Chen, Linchao Bao, Haoxian Zhang, Sheng Wang, Xuefei Zhe, Xinwei Jiang, Jue Wang, Dong Yu, Zhengyou Zhang.
TOG 2021. [PDF] [Code] [Project]

Real-time Deep Dynamic Characters.
Marc Habermann, Lingjie Liu, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt.
TOG 2021. [PDF] [Project]

Learning Skeletal Articulations with Neural Blend Shapes.
Peizhuo Li, Kfir Aberman, Rana Hanocka, Libin Liu, Olga Sorkine-Hornung, Baoquan Chen.
TOG 2021. [PDF] [Video] [Project]

Detailed Avatar Recovery from Single Image.
Hao Zhu, Xinxin Zuo, Haotian Yang, Sen Wang, Xun Cao, Ruigang Yang.
TPAMI 2021. [PDF]

RSC-Net: 3D Human Pose, Shape and Texture from Low-Resolution Images and Videos.
Xiangyu Xu, Hao Chen, Francesc Moreno-Noguer, Laszlo A. Jeni, Fernando De la Torre.
TPAMI 2021. [PDF] [Code] [Project]

A Deeper Look into DeepCap.
Marc Habermann, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt.
TPAMI 2021. [PDF] [Code] [Data]

Learning Implicit 3D Representations of Dressed Humans from Sparse Views.
Pierre Zins, Yuanlu Xu, Edmond Boyer, Stefanie Wuhrer, Tony Tung.
3DV 2021. [PDF]

PIXIE: Collaborative Regression of Expressive Bodies using Moderation.
Yao Feng, Vasileios Choutas, Timo Bolkart, Dimitrios Tzionas, Michael J. Black.
3DV 2021. [PDF] [Project]

A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Pose.
Shih-Yang Su, Frank Yu, Michael Zollhoefer, Helge Rhodin.
NeurIPS 2021. [PDF] [Project]

Class-agnostic Reconstruction of Dynamic Objects from Videos.
Zhongzheng Ren, Xiaoming Zhao, Alexander G. Schwing.
NeurIPS 2021. [PDF] [Project]

Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Rendering.
Youngjoong Kwon, Dahun Kim, Duygu Ceylan, Henry Fuchs.
NeurIPS 2021. [PDF]

MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images.
Shaofei Wang, Marko Mihajlovic, Qianli Ma, Andreas Geiger, Siyu Tang.
NeurIPS 2021. [PDF] [Project] [Code]

Garment4D: Garment Reconstruction from Point Cloud Sequences.
Fangzhou Hong, Liang Pan, Zhongang Cai, Ziwei Liu.
NeurIPS 2021. [PDF] [Project] [Code]

Learning Anchored Unsigned Distance Functions with Gradient Direction Alignment for Single-view Garment Reconstruction.
Fang Zhao, Wenhao Wang, Shengcai Liao, Ling Shao.
ICCV 2021. [PDF] [Code]

Dynamic Surface Function Networks for Clothed Human Bodies.
Andrei Burov, Matthias Nießner, Justus Thies.
ICCV 2021. [PDF] [Video] [Code]

THUNDR: Transformer-based 3D HUmaN Reconstruction with Markers.
Mihai Zanfir, Andrei Zanfir, Eduard Gabriel Bazavan, William T. Freeman, Rahul Sukthankar, Cristian Sminchisescu.
ICCV 2021. [PDF]

Neural Articulated Radiance Field.
Atsuhiro Noguchi, Xiao Sun, Stephen Lin, Tatsuya Harada.
ICCV 2021. [PDF]

3D Human Texture Estimation From a Single Image With Transformers.
Xiangyu Xu, Chen Change Loy.
ICCV 2021. [PDF]

ARCH++: Animation-Ready Clothed Human Reconstruction Revisited.
Tong He, Yuanlu Xu, Shunsuke Saito, Stefano Soatto, Tony Tung.
ICCV 2021. [PDF]

DeePSD: Automatic Deep Skinning and Pose Space Deformation for 3D Garment Animation.
Hugo Bertiche, Meysam Madadi, Emilio Tylson, Sergio Escalera.
ICCV 2021. [PDF]

EgoRenderer: Rendering Human Avatars From Egocentric Camera Images.
Tao Hu, Kripasindhu Sarkar, Lingjie Liu, Matthias Zwicker, Christian Theobalt.
ICCV 2021. [PDF]

SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes.
Xu Chen, Yufeng Zheng, Michael J. Black, Otmar Hilliges, Andreas Geiger.
ICCV 2021. [PDF] [[Project](https://xuchen-ethz.github.io/snarf/] [Code]

Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothing.
Garvita Tiwari, Nikolaos Sarafianos, Tony Tung, Gerard Pons-Moll.
ICCV 2021. [PDF] [Project]

The Power of Points for Modeling Humans in Clothing.
Qianli Ma, Jinlong Yang, Siyu Tang, Michael J. Black.
ICCV 2021. [PDF] [Project] [Code]

Learning to Regress Bodies from Images using Differentiable Semantic Rendering.
Sai Kumar Dwivedi, Nikos Athanasiou, Muhammed Kocabas, Michael J. Black.
ICCV 2021. [PDF] [Project]

imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Pose.
Thiemo Alldieck, Hongyi Xu, Cristian Sminchisescu.
ICCV 2021. [PDF]

DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Cameras.
Yang Zheng, Ruizhi Shao, Yuxiang Zhang, Zerong Zheng, Tao Yu, Yebin Liu.
ICCV 2021. [PDF] [Project]

Animatable Neural Radiance Fields for Human Body Modeling.
Sida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang, Qing Shuai, Hujun Bao, Xiaowei Zhou.
ICCV 2021. [PDF] [Project] [Code]

Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies.
Sida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang, Qing Shuai, Xiaowei Zhou, Hujun Bao.
ICCV 2021. [PDF] [Project]

Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensors.
Tao Yu, Zerong Zheng, Kaiwen Guo, Pengpeng Liu, Qionghai Dai, Yebin Liu.
CVPR 2021 (oral). [PDF] [Project] [THuman2.0 Dataset]

POSEFusion: Pose-guided Selective Fusion for Single-view Human Volumetric Capture.
Zhe Li, Tao Yu, Zerong Zheng, Kaiwen Guo, Yebin Liu.
CVPR 2021. [PDF] [Project]

SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networks.
Shunsuke Saito, Jinlong Yang, Qianli Ma, Michael J. Black.
CVPR 2021. [PDF] [Code]

Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinement.
Huiwen Luo, Koki Nagano, Han-Wei Kung, Qingguo Xu, Zejian Wang, Lingyu Wei, Liwen Hu, Hao Li.
CVPR 2021. [PDF]

DeepSurfels: Learning Online Appearance Fusion.
Marko Mihajlovic, Silvan Weder, Marc Pollefeys, Martin R. Oswald.
CVPR 2021. [PDF] [Project] [Code]

Semi-Supervised Synthesis of High-Resolution Editable Textures for 3D Humans.
Bindita Chaudhuri, Nikolaos Sarafianos, Linda Shapiro, Tony Tung.
CVPR 2021. [PDF]

StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision.
Yang Hong, Juyong Zhang, Boyi Jiang, Yudong Guo, Ligang Liu, Hujun Bao.
CVPR 2021. [PDF] [Project] [Code]

LASR: Learning Articulated Shape Reconstruction from a Monocular Video.
Gengshan Yang, Deqing Sun, Varun Jampani, Daniel Vlasic, Forrester Cole, Huiwen Chang, Deva Ramanan, William T. Freeman, Ce Liu.
CVPR 2021. [PDF] [Project]

Multi-person Implicit Reconstruction from a Single Image.
Armin Mustafa, Akin Caliskan, Lourdes Agapito, Adrian Hilton.
CVPR 2021. [PDF]

StylePeople: A Generative Model of Fullbody Human Avatars.
Artur Grigorev, Karim Iskakov, Anastasia Ianina, Renat Bashirov, Ilya Zakharkin, Alexander Vakhitov, Victor Lempitsky.
CVPR 2021. [PDF]

SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elements.
Qianli Ma, Shunsuke Saito, Jinlong Yang, Siyu Tang, Michael J. Black.
CVPR 2021. [PDF] [Project]

Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humans.
Bindita Chaudhuri, Nikolaos Sarafianos, Linda Shapiro, Tony Tung.
CVPR 2021. [PDF]

Monocular Real-time Full Body Capture with Inter-part Correlations.
Yuxiao Zhou, Marc Habermann, Ikhsanul Habibie, Ayush Tewari, Christian Theobalt, Feng Xu.
CVPR 2021. [PDF]

SMPLicit: Topology-aware Generative Model for Clothed People.
Enric Corona, Albert Pumarola, Guillem Alenyà, Gerard Pons-Moll, Francesc Moreno-Noguer.
CVPR 2021. [PDF] [Project]

A Deep Emulator for Secondary Motion of 3D Characters.
Mianlun Zheng, Yi Zhou, Duygu Ceylan, Jernej Barbic.
CVPR 2021. [PDF]

PVA: Pixel-aligned Volumetric Avatars.
Amit Raj, Michael Zollhoefer, Tomas Simon, Jason Saragih, Shunsuke Saito, James Hays, Stephen Lombardi.
CVPR 2021. [PDF] [Project]

ANR: Articulated Neural Rendering for Virtual Avatars.
Amit Raj, Julian Tanke, James Hays, Minh Vo, Carsten Stoll, Christoph Lassner.
CVPR 2021. [PDF] [Project]

SMPLpix: Neural Avatars from 3D Human Models.
Sergey Prokudin, Michael J. Black, Javier Romero.
WACV 2021. [PDF] [Code]

Synthetic Training for Monocular Human Mesh Recovery.
Yu Sun, Qian Bao, Wu Liu, Wenpeng Gao, Yili Fu, Chuang Gan, Tao Mei.
BMVC 2020. [PDF]

Realistic Virtual Humans from Smartphone Videos.
Stephan Wenninger, Jascha Achenbach, Andrea Bartl, Marc Erich Latoschik, Mario Botsch.
ACM VRST 2020 (Best Paper Award). [PDF] [Video] [Talk]

LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registration.
Bharat Lal Bhatnagar, Cristian Sminchisescu, Christian Theobalt, Gerard Pons-Moll.
NeurIPS 2020. [PDF] [Code]

3D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image Data.
Benjamin Biggs, Sébastien Ehrhadt, Hanbyul Joo, Benjamin Graham, Andrea Vedaldi, David Novotny.
NeurIPS 2020. [PDF]

HPBTT: Human Parsing Based Texture Transfer from Single Image to 3D Human via Cross-View Consistency.
Fang Zhao, Shengcai Liao, Kaihao Zhang, Ling Shao.
NeurIPS 2020. [PDF] [Code]

Neural3D: Light-weight Neural Portrait Scanning via Context-aware Correspondence Learning.
Xin Suo, Minye Wu, Yanshun Zhang, Yanshun Zhang, Yingliang Zhang, Yingliang Zhang, Lan Xu, Qiang Hu, Jingyi Yu.
ACM MM 2020. [PDF]

3DBooSTeR: 3D Body Shape and Texture Recovery.
Alexandre Saint, Anis Kacem, Kseniya Cherenkova, Djamila Aouada.
ECCV 2020 Workshop. [PDF]

BCNet: Learning Body and Cloth Shape from A Single Image.
Boyi Jiang, Juyong Zhang, Yang Hong, Jinhao Luo, Ligang Liu, Hujun Bao.
ECCV 2020. [PDF]

MonoPort: Monocular Real-Time Volumetric Performance Capture.
Ruilong Li, Yuliang Xiu, Shunsuke Saito, Zeng Huang, Kyle Olszewski, Hao Li.
ECCV 2020. [PDF] [Code]

3D Human Shape and Pose from a Single Low-Resolution Image with Self-Supervised Learning.
Xiangyu Xu, Hao Chen, Francesc Moreno-Noguer, Laszlo A. Jeni, Fernando De la Torre.
ECCV 2020. [PDF] [Project]

BLSM: A Bone-Level Skinned Model of the Human Mesh.
Haoyang Wang, Riza Alp Güler, Iasonas Kokkinos, George Papandreou, Stefanos Zafeiriou.
ECCV 2020. [pdf] [Supplement]

STAR: Sparse Trained Articulated Human Body Regressor.
Ahmed A. A. Osman, Timo Bolkart, Michael J. Black.
ECCV 2020. [PDF] [Project]

I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image.
Gyeongsik Moon, Kyoung Mu Lee.
ECCV 2020. [PDF] [Code]

Appearance Consensus Driven Self-Supervised Human Mesh Recovery.
Jogendra Nath Kundu, Mugalodi Rakesh, Varun Jampani, Rahul Mysore Venkatesh, R. Venkatesh Babu.
ECCV 2020. [PDF]

TexMesh: Reconstructing Detailed Human Texture and Geometry from RGB-D Video.
Tiancheng Zhi, Christoph Lassner, Tony Tung, Carsten Stoll, Srinivasa G. Narasimhan, Minh Vo.
ECCV 2020. [PDF]

NormalGAN: Learning Detailed 3D Human from a Single RGB-D Image.
Lizhen Wang, Xiaochen Zhao, Tao Yu, Songtao Wang, Yebin Liu.
ECCV 2020. [PDF] [Project]

Reconstructing NBA Players.
Luyang Zhu, Konstantinos Rematas, Brian Curless, Steve Seitz, Ira Kemelmacher-Shlizerman.
ECCV 2020. [PDF] [Code] [Project]

RobustFusion: Human Volumetric Capture with Data-driven Visual Cues using a RGBD Camera.
Zhuo Su, Xu Lan, Zerong Zheng, Tao Yu, Yebin Liu, Lu Fang.
ECCV 2020. [PDF]

IPNet: Combining Implicit Function Learning and Parametric Models for 3D Human Reconstruction.
Bharat Lal Bhatnagar, Cristian Sminchisescu, Christian Theobalt, Gerard Pons-Moll.
ECCV 2020. [PDF] [Project] [Code]

Neural Articulated Shape Approximation.
Boyang Deng, JP Lewis, Timothy Jeruzalski, Gerard Pons-Moll, Geoffrey Hinton, Mohammad Norouzi, Andrea Tagliasacchi.
ECCV 2020. [PDF]

SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothing.
Garvita Tiwari, Bharat Lal Bhatnagar, Tony Tung, Gerard Pons-Moll.
ECCV 2020. [PDF] [Data] [Code] [Project]

TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style.
Chaitanya Patel, Zhouyingcheng Liao, Gerard Pons-Moll.
CVPR 2020. [PDF] [Code] [Project] [Data]

Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstruction.
Tong He, John Collomosse, Hailin Jin, Stefano Soatto.
NeurIPS 2020. [PDF] [Code]

Self-Supervised Human Depth Estimation from Monocular Videos.
Feitong Tan, Hao Zhu, Zhaopeng Cui, Siyu Zhu, Marc Pollefeys, Ping Tan.
CVPR 2020. [PDF]

ARCH: Animatable Reconstruction of Clothed Humans.
Zeng Huang, Yuanlu Xu, Christoph Lassner, Hao Li, Tony Tung.
CVPR 2020. [PDF]

pix2surf: Learning to Transfer Texture from Clothing Images to 3D Humans.
Aymen Mir, Thiemo Alldieck, Gerard Pons-Moll.
CVPR 2020. [PDF] [Code]

PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization.
Shunsuke Saito, Tomas Simon, Jason Saragih, Hanbyul Joo.
CVPR 2020. [PDF] [Project] [Code]

DeepCap: Monocular Human Performance Capture Using Weak Supervision.
Marc Habermann, Weipeng Xu, Michael Zollhoefer, erard Pons-Moll, Christian Theobalt.
CVPR 2020. [PDF] [Project]

EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Camera.
Lan XU, Weipeng Xu, Vladislav Golyanik, Marc Habermann, Lu Fang, Christian Theobalt.
CVPR 2020. [PDF] [Project]

DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Data.
Aljaž Božič, Michael Zollhöfer, Christian Theobalt, Matthias Nießner.
CVPR 2020. [PDF] [Project] [Code] [DeepDeform Benchmark]

Implicit Functions in Feature Space for 3D Shape Reconstruction and Completion.
Julian Chibane, Thiemo Alldieck, Gerard Pons-Moll.
CVPR 2020. [PDF]

DeepCap: Monocular Human Performance Capture Using Weak Supervision.
Marc Habermann, Weipeng Xu, Michael and Zollhoefer, Gerard Pons-Moll, Christian Theobalt.
CVPR 2020. [PDF]

TetraTSDF: 3D Human Reconstruction from A Single Image with A Tetrahedral Outer Shell.
Hayato Onizuka, Zehra Hayirci, Diego Thomas, Akihiro Sugimoto, Hideaki Uchiyama, Rin-ichiro Taniguchi.
CVPR 2020. [PDF] [Code]

Multi-View Consistency Loss for Improved Single-Image 3D Reconstruction of Clothed People.
Akin Caliskan, Adrian Hilton.
ACCV 2020. [PDF] [Code]

PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstruction.
Zerong Zheng, Tao Yu, Yebin Liu, Qionghai Dai.
TPAMI 2020. [PDF] [Project]

MulayCap: Multi-layer Human Performance Capture Using A Monocular Video Camera.
Zhaoqi Su, Weilin Wan, Tao Yu, Lingjie Liu, Lu Fang, Wenping Wang and Yebin Liu.
TVCG 2020. [PDF] [Project]

Disentangled Human Body Embedding Based on Deep Hierarchical Neural Network.
Boyi Jiang, Juyong Zhang, Jianfei Cai, Jianmin Zheng.
TVCG 2020. [PDF]

SparseFusion: Dynamic Human Avatar Modeling from Sparse RGBD Images.
Xinxin Zuo, Sen Wang, Jiangbin Zheng, Weiwei Yu, Minglun Gong, Ruigang Yang, Li Cheng.
TMM 2020. [PDF]

UnstructuredFusion: Real-time 4D Geometry and Texture Reconstruction using Commercial RGBD Cameras.
Lan Xu, Zhuo Su, Lei Han, Tao Yu, Yebin Liu, Lu Fang.
TPAMI 2019. [PDF]

PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization.
Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima, Angjoo Kanazawa, Hao Li.
ICCV 2019. [PDF] [Project] [Code]

Multi-Garment Net_Learning to Dress 3D people from Images.
Bharat Lal Bhatnagar, Garvita Tiwari, Christian Theobalt, Gerard Pons-Moll.
ICCV 2019. [Code] [PDF]

Learning to Reconstruct People in Clothing from a Single RGB Camera.
Thiemo Alldieck, Marcus Magnor, Bharat Lal Bhatnagar, Christian Theobalt, Gerard Pons-Moll.
ICCV 2019. [PDF] [Code]

A Neural Network for Detailed Human Depth Estimation From a Single Image.
Sicong Tang, Feitong Tan, Kelvin Cheng, Zhaoyang Li, Siyu Zhu, Ping Tan.
ICCV 2019. [PDF]

TexturePose: Supervising Human Mesh Estimation with Texture Consistency.
Georgios Pavlakos, Nikos Kolotouros, Kostas Daniilidis.
ICCV 2019. [PDF] [Project] [Code]

3DPeople: Modeling the Geometry of Dressed Humans.
Albert Pumarola, Jordi Sanchez, Gary P. T. Choi, Alberto Sanfeliu, Francesc Moreno-Noguer.
ICCV 2019. [PDF] [3DPeople-Dataset]

DeepHuman: 3D Human Reconstruction from a Single Image.
Zerong Zheng, Tao Yu, Yixuan Wei, Qionghai Dai, Yebin Liu.
ICCV 2019. [PDF] [Project]

Tex2Shape: Detailed Full Human Body Geometry From a Single Image.
Thiemo Alldieck, Gerard Pons-Moll, Christian Theobalt, Marcus Magnor.
CVPR 2019. [PDF] [Code]

SimulCap : Single-View Human Performance Capture with Cloth Simulation.
Tao Yu, Zerong Zheng, Yuan Zhong, Jianhui Zhao, Qionghai Dai, Gerard Pons-moll, Yebin Liu.
CVPR 2019. [PDF] [Project]

SiCloPe: Silhouette-Based Clothed People.
Ryota Natsume, Shunsuke Saito, Zeng Huang, Weikai Chen, Chongyang Ma, Hao Li, Shigeo Morishima.
CVPR 2019. [PDF]

Textured Neural Avatars.
Aliaksandra Shysheya, Egor Zakharov, Kara-Ali Aliev, Renat Bashirov, Egor Burkov, Karim Iskakov, Aleksei Ivakhnenko, Yury Malkov, Igor Pasechnik, Dmitry Ulyanov, Alexander Vakhitov, Victor Lempitsky.
CVPR 2019 (oral). [PDF] [Project]

MonoClothCap: Towards Temporally Coherent Clothing Capture from Monocular RGB Video.
Donglai Xiang, Fabian Prada, Chenglei Wu, Jessica Hodgins.
3DV 2020 (Best Paper Honorable Mention, Oral). [PDF]

360-Degree Textures of People in Clothing from a Single Image.
Verica Lazova, Eldar Insafutdinov, Gerard Pons-Moll.
3DV 2019. [PDF] [Project]

Detailed Human Avatars from Monocular Video.
Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, Gerard Pons-Moll.
3DV 2018. [PDF] [Code]

BodyFusion: Real-time Capture of Human Motion and Surface Geometry Using a Single Depth Camera.
Tao Yu, Kaiwen Guo, Feng Xu, Yuan Dong, Zhaoqi Su, Jianhui Zhao, Jianguo Li, Qionghai Dai, Yebin Liu.
ICCV 2017. [PDF] [Project]

GNeuVox: Generalizable Neural Voxels for Fast Human Radiance Fields.
Taoran Yi, Jiemin Fang, Xinggang Wang, Wenyu Liu.
arXiv 2023. [PDF] [Project] [Code]

3D Magic Mirror: Clothing Reconstruction from a Single Image via a Causal Perspective.
Zhedong Zheng, Jiayin Zhu, Wei Ji, Yi Yang, and Tat-Seng Chua.
arXiv 2022. [PDF] [Project] [Code)]

DRaCoN: Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars.
Amit Raj, Umar Iqbal, Koki Nagano, Sameh Khamis, Pavlo Molchanov, James Hays, Jan Kautz.
arXiv 2022. [PDF] [Project]

Cloth Modelling, Draping, Simulation, and Dressing

A Generative Multi-Resolution Pyramid and Normal-Conditioning 3D Cloth Draping.
Hunor Laczkó, Meysam Madadi, Sergio Escalera, Jordi Gonzalez.
WACV 2024. [PDF]

Towards Multi-Layered 3D Garments Animation.
Yidi Shao, Chen Change Loy, Bo Dai.
ICCV 2023. [PDF] [Project]

REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videos.
Lingteng Qiu, Guanying Chen, Jiapeng Zhou, Mutian Xu, Junle Wang, Xiaoguang Han.
CVPR 2023. [PDF] [Project] [Code]

HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics.
Artur Grigorev, Bernhard Thomaszewski, Michael J. Black, Otmar Hilliges.
CVPR 2023. [PDF] [Project] [Code]

Deep Deformation Detail Synthesis for Thin Shell Models.
Lan Chen, Lin Gao, Jie Yang, Shibiao Xu, Juntao Ye, Xiaopeng Zhang, Yu-Kun Lai.
CGF 2023. [PDF]

Motion Guided Deep Dynamic 3D Garments.
Meng Zhang, Duygu Ceylan, Niloy J. Mitra.
SIGGRAPH Asia 2022. [PDF] [Project]

Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networks.
Xiaoyu Pan, Jiaming Mai, Xinwei Jiang, Dongxue Tang, Jingxiang Li, Tianjia Shao, Kun Zhou, Xiaogang Jin, Dinesh Manocha.
SIGGRAPH 2022. [PDF] [Code]

DiffCloth: Differentiable Cloth Simulation with Dry Frictional Contact.
Yifei Li, Tao Du, Kui Wu, Jie Xu, Wojciech Matusik.
TOG 2022. [PDF] [Project] [Code]

DIG: Draping Implicit Garment over the Human Body.
Ren Li, Benoît Guillard, Edoardo Remelli, Pascal Fua.
ACCV 2022. [PDF]

SNUG: Self-Supervised Neural Dynamic Garments.
Igor Santesteban, Miguel A. Otaduy, Dan Casas.
CVPR 2022 (Oral). [PDF] [Project] [Code]

Registering Explicit to Implicit: Towards High-Fidelity Garment mesh Reconstruction from Single Images.
Heming Zhu, Lingteng Qiu, Yuda Qiu, Xiaoguang Han.
CVPR 2022. [PDF] [Project]

Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On.
Igor Santesteban, Nils Thuerey, Miguel A. Otaduy, Dan Casas.
CVPR 2021. [PDF]

Dynamic Neural Garments.
Meng Zhang, Duygu Ceylan, Tuanfeng Wang, Niloy J. Mitra.
TOG 2021. [PDF] [Project] [Code]

PBNS: Physically Based Neural Simulation for Unsupervised Outfit Pose Space Deformation.
Hugo Bertiche, Meysam Madadi, Sergio Escalera.
SIGGRAPH Asia 2021. [PDF] [Project] [Code]

Deep Detail Enhancement for Any Garment.
Meng Zhang, Tuanfeng Wang, Duygu Ceylan, Niloy J. Mitra.
Eurographics 2021. [PDF]

Deep Physics-aware Inference of Cloth Deformation for Monocular Human Performance Capture.
Yue Li, Marc Habermann, Bernhard Thomaszewski, Stelian Coros, Thabo Beeler, Christian Theobalt.
3DV 2021. [PDF]

Neural Non-Rigid Tracking.
Aljaž Božič, Pablo Palafox, Michael Zollhöfer, Angela Dai, Justus Thies, Matthias Nießner.
NeurIPS 2020. [PDF]

SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothing.
Garvita Tiwari, Bharat Lal Bhatnagar, Tony Tung, Gerard Pons-Moll.
ECCV 2020. [PDF]

GAN-based Garment Generation Using Sewing Pattern Images.
Yu Shen, Junbang Liang, Ming C. Lin.
ECCV 2020. [PDF] [Project] [Code]

Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images.
Heming Zhu, Yu Cao, Hang Jin, Weikai Chen, Dong Du, Zhangye Wang, Shuguang Cui, Xiaoguang Han.
ECCV 2020. [PDF] [Project]

GarNet++: Improving Fast and Accurate Static3D Cloth Draping by Curvature Loss.
Erhan Gundogdu, Victor Constantin, Shaifali Parashar, Amrollah Seifoddini, Minh Dang, Mathieu Salzmann, Pascal Fua.
TPAMI 2020. [PDF]

Homogenized Yarn-Level Cloth.
Georg Sperl, Rahul Narain, Chris Wojtan.
SIGGRAPH (TOG) 2020. [PDF] [Project] [Data & Code]

CLOTH3D: Clothed 3D Humans.
Hugo Bertiche, Meysam Madadi, Sergio Escalera.
ECCV 2020. [PDF]

CAPE: Learning to Dress 3D People in Generative Clothing.
Qianli Ma, Jinlong Yang, Anurag Ranjan, Sergi Pujades, Gerard Pons-Moll, Siyu Tang, Michael J. Black.
CVPR 2020. [PDF] [Project]

Learning to Dress 3D People in Generative Clothing.
Qianli Ma, Jinlong Yang, Anurag Ranjan, Sergi Pujades, Gerard Pons-Moll, Siyu Tang, Michael J. Black.
CVPR 2020. [PDF]

The Virtual Tailor: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style.
Chaitanya Patel, Zhouyingcheng Liao, Gerard Pons-Moll.
CVPR 2020. [PDF]

Learning to Transfer Texture from Clothing Images to 3D Humans.
Aymen Mir, Thiemo Alldieck, Gerard Pons-Moll.
CVPR 2020. [PDF] [Code]

GarNet: A Two-Stream Network for Fast and Accurate 3D Cloth Draping.
Erhan Gundogdu, Victor Constantin, Amrollah Seifoddini, Minh Dang, Mathieu Salzmann, Pascal Fua.
ICCV 2019. [PDF] [Supplementary Material] [Project] [Dataset]

Multi-Garment Net: Learning to Dress 3D People from Images.
Bharat Lal Bhatnagar, Garvita Tiwari, Christian Theobalt, Gerard Pons-Moll(REAL VIRTUAL HUMANS, MPII).
ICCV 2019. [PDF]

DRAPE: DRessing Any PErson.
Peng Guan, Loretta Reiss, David A. Hirshberg, Alexander Weiss, Michael J. Black.
TOG 2012. [PDF] [Project]

Human Image and Video Generation

Gaussian Shell Maps for Efficient 3D Human Generation.
Rameen Abdal, Wang Yifan, Zifan Shi, Yinghao Xu, Ryan Po, Zhengfei Kuang, Qifeng Chen, Dit-Yan Yeung, Gordon Wetzstein.
CVPR 2024. [PDF] [Project]

HyperHuman: Hyper-Realistic Human Generation with Latent Structural Diffusion.
Xian Liu, Jian Ren, Aliaksandr Siarohin, Ivan Skorokhodov, Yanyu Li, Dahua Lin, Xihui Liu, Ziwei Liu, Sergey Tulyakov.
ICLR 2024. [PDF] [Project]

VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesis.
Xinya Chen, Jiaxin Huang, Yanrui Bin, Lu Yu, Yiyi Liao.
ICCV 2023. [PDF]

UnitedHuman: Harnessing Multi-Source Data for High-Resolution Human Generation.
Jianglin Fu, Shikai Li, Yuming Jiang, Kwan-Yee Lin, Wayne Wu, Ziwei Liu.
ICCV 2023. [PDF] [Project] [Github]

Text2Performer: Text-Driven Human Video Generation.
Yuming Jiang, Shuai Yang, Tong Liang Koh, Wayne Wu, Chen Change Loy, Ziwei Liu.
ICCV 2023. [PDF] [Project] [Code]

Cross Attention Based Style Distribution for Controllable Person Image Synthesis.
Xinyue Zhou, Mingyu Yin, Xinyuan Chen, Li Sun, Changxin Gao, Qingli Li.
ECCV 2022. [PDF]

StyleGAN-Human: A Data-Centric Odyssey of Human Generation.
Jianglin Fu, Shikai Li, Yuming Jiang, Kwan-Yee Lin, Chen Qian, Chen Change Loy, Wayne Wu, Ziwei Liu.
ECCV 2022. [PDF] [Code] [Project] [Colab Demo] [Hugging Face Demo]

Text2Human: Text-Driven Controllable Human Image Generation.
Yuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu, Chen Change Loy, Ziwei Liu.
SIGGRAPH 2022. [PDF] [Code] [Project]

Self-Supervised Correlation Mining Network for Person Image Generation.
Zijian Wang, Xingqun Qi, Kun Yuan, Muyi Sun.
CVPR 2022. [PDF]

BodyGAN: General-Purpose Controllable Neural Human Body Generation.
Chaojie Yang, Hanhui Li, Shengjie Wu, Shengkai Zhang, Haonan Yan, Nianhong Jiao, Jie Tang, Runnan Zhou, Xiaodan Liang, Tianxiang Zheng.
CVPR 2022. [PDF]

InsetGAN for Full-Body Image Generation.
Anna Frühstück, Krishna Kumar Singh, Eli Shechtman, Niloy J. Mitra, Peter Wonka, Jingwan Lu.
CVPR 2022. [PDF] [Project]

Neural Texture Extraction and Distribution for Controllable Person Image Synthesis.
Yurui Ren, Xiaoqing Fan, Ge Li, Shan Liu, Thomas H. Li.
CVPR 2022 (oral). [PDF] [Code]

Exploring Dual-task Correlation for Pose Guided Person Image Generation.
Pengze Zhang, Lingxiao Yang, Jianhuang Lai, Xiaohua Xie.
CVPR 2022. [PDF]

Structure-Transformed Texture-Enhanced Network for Person Image Synthesis.
Munan Xu, Yuanqi Chen, Shan Liu, Thomas H. Li, Ge Li.
ICCV 2021. [PDF]

PISE: Person Image Synthesis and Editing with Decoupled GAN.
Jinsong Zhang, Kun Li, Yu-Kun Lai, Jingyu Yang.
CVPR 2021. [PDF] [Project] [Code]

XingGAN for Person Image Generation.
Hao Tang, Song Bai, Li Zhang, Philip H. S. Torr, Nicu Sebe.
ECCV 2020. [Code]

Progressive Pose Attention Transfer for Person Image Generation.
Zhen Zhu, Tengteng Huang, Baoguang Shi, Miao Yu, Bofei Wang, Xiang Bai.
CVPR 2019 (oral). [PDF] [Code]

Generating Person Images with Appearance-aware Pose Stylizer.
Siyu Huang, Haoyi Xiong, Zhi-Qi Cheng, Qingzhong Wang, Xingran Zhou, Bihan Wen, Jun Huan, Dejing Dou.
IJCAI 2020. [PDF] [Code]

Text-guided 3D Human Generation from 2D Collections.
Tsu-Jui Fu, Wenhan Xiong, Yixin Nie, Jingyu Liu, Barlas Oğuz, William Yang Wang.
arXiv 2023. [PDF] [Project]

LEO: Generative Latent Image Animator for Human Video Synthesis.
Yaohui Wang, Xin Ma, Xinyuan Chen, Antitza Dantcheva, Bo Dai, Yu Qiao.
arXiv 2023. [PDF] [Project] [Code]

Image-Based Virtual Try-On

[Awesome Virtual Try-on (VTON)]

FashionTex: Controllable Virtual Try-on with Text and Texture.
Anran Lin, Nanxuan Zhao, Shuliang Ning, Yuda Qiu, Baoyuan Wang, Xiaoguang Han.
SIGGRAPH 2023. [PDF]

TryOnDiffusion: A Tale of Two UNets.
Luyang Zhu, Dawei Yang, Tyler Zhu, Fitsum Reda, William Chan, Chitwan Saharia, Mohammad Norouzi, Ira Kemelmacher-Shlizerman.
CVPR 2023. [PDF] [Project]

High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditions.
Sangyun Lee, Gyojung Gu, Sunghyun Park, Seunghwan Choi, Jaegul Choo.
ECCV 2022. [PDF] [Project] [Code]

Single Stage Virtual Try-on via Deformable Attention Flows.
Shuai Bai, Huiling Zhou, Zhikang Li, Chang Zhou, Hongxia Yang.
ECCV 2022. [PDF]

MGN: A Regional Mask Guided Network for Parser-free Virtual Try-on.
Chao Lin, Zhao Li, Sheng Zhou, Shichang Hu, Jialun Zhang, Linhao Luo, Jiarun Zhang, Longtao Huang, Yuan He.
IJCAI 2022. [PDF]

ClothFormer: Taming Video Virtual Try-on in All Module.
Jianbin Jiang, Tan Wang, He Yan, Junhui Liu.
CVPR 2022 (oral). [PDF] [Project]

Style-Based Global Appearance Flow for Virtual Try-On.
Sen He, Yi-Zhe Song, Tao Xiang.
CVPR 2022. [PDF]

Dressing in the Wild by Watching Dance Videos.
Xin Dong, Fuwei Zhao, Zhenyu Xie, Xijin Zhang, Daniel K. Du, Min Zheng, Xiang Long, Xiaodan Liang, Jianchao Yang.
CVPR 2022. [PDF] [Project]

CIT: Cloth Interactive Transformer for Virtual Try-On.
Bin Ren, Hao Tang, Fanyang Meng, Runwei Ding, Ling Shao, Philip H.S. Torr, Nicu Sebe.
CVPR 2022. [PDF] [Code]

Weakly Supervised High-Fidelity Clothing Model Generation.
Ruili Feng, Cheng Ma, Chengji Shen, Xin Gao, Zhenjiang Liu, Xiaobo Li, Kairi Ou, Zhengjun Zha.
CVPR 2022. [PDF]

WAS-VTON: Warping Architecture Search for Virtual Try-on Network.
Zhenyu Xie, Xujie Zhang, Fuwei Zhao, Haoye Dong, Michael C. Kampffmeyer, Haonan Yan, Xiaodan Liang.
ACM MM 2021. [PDF]

Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN.
Zhenyu Xie, Zaiyu Huang, Fuwei Zhao, Haoye Dong, Michael Kampffmeyer, Xiaodan Liang.
NeurIPS 2021. [PDF] [Code]

ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priors.
Ayush Chopra, Rishabh Jain, Mayur Hemani, Balaji Krishnamurthy.
ICCV 2021. [PDF]

Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-On and Outfit Editing.
Aiyu Cui, Daniel McKee, Svetlana Lazebnik.
ICCV 2021. [PDF]

FashionMirror: Co-Attention Feature-Remapping Virtual Try-On With Sequential Template Poses.
Chieh-Yun Chen, Ling Lo, Pin-Jui Huang, Hong-Han Shuai, Wen-Huang Cheng.
ICCV 2021. [PDF]

M3D-VTON: A Monocular-to-3D Virtual Try-On Network.
Fuwei Zhao, Zhenyu Xie, Michael Kampffmeyer, Haoye Dong, Songfang Han, Tianxiang Zheng, Tao Zhang, Xiaodan Liang.
ICCV 2021. [PDF]

Shape Controllable Virtual Try-on for Underwear Models.
Xin Gao, Zhenjiang Liu, Zunlei Feng, Chengji Shen, Kairi Ou, Haihong Tang, Mingli Song.
ACM MM 2021. [PDF]

TryOnGAN: Body-aware Try-on via Layered Interpolation.
Kathleen M Lewis, Srivatsan Varadharajan, Ira Kemelmacher-Shlizerman.
TOG 2021. [PDF] [Project] [Demo]

VOGUE: Try-On by StyleGAN Interpolation Optimization.
Kathleen M Lewis, Srivatsan Varadharajan, Ira Kemelmacher-Shlizerman.
CVPR 2021. [PDF] [Project] [Code]

Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing.
Aiyu Cui, Daniel McKee, Svetlana Lazebnik.
CVPR 2021. [PDF] [Code]

Toward Accurate and Realistic Outfits Visualization With Attention to Details.
Kedan Li, Min Jin Chong, Jeffrey Zhang, Jingen Liu.
CVPR 2021. [PDF] [Demo]

VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization.
Seunghwan Choi, Sunghyun Park, Minsoo Lee, Jaegul Choo.
CVPR 2021. [PDF]

HumanGAN: A Generative Model of Humans Images.
Kripasindhu Sarkar, Lingjie Liu, Vladislav Golyanik, Christian Theobalt.
CVPR 2021. [PDF] [Project]

DCTON: Disentangled Cycle Consistency for Highly-realistic Virtual Try-On.
Chongjian Ge, Yibing Song, Yuying Ge, Han Yang, Wei Liu, and Ping Luo.
CVPR 2021. [PDF] [Code]

PF-AFN: Parser-Free Virtual Try-on via Distilling Appearance Flows.
Yuying Ge, Yibing Song, Ruimao Zhang, Chongjian Ge, Wei Liu, Ping Luo.
CVPR 2021. [PDF] [Code]

Template-Free Try-on Image Synthesis via Semantic-guided Optimization.
Chien-Lung Chou, Chieh-Yun Chen, Chia-Wei Hsieh, Hong-Han Shuai, Jiaying Liu, Wen-Huang Cheng.
TNNLS 2021. [PDF]

Unpaired Person Image Generation with Semantic Parsing Transformation.
Sijie Song, Wei Zhang, Jiaying Liuv, Zongming Guo, Tao Mei.
TPAMI 2020. [PDF] [CVPR 2019] [TPAMI 2020] [Code]

Do Not Mask What You Do Not Need to Mask: a Parser-Free Virtual Try-On.
Thibaut Issenhuth, Jérémie Mary, Clément Calauzènes.
ECCV 2020. [PDF]

Fully Convolutional Graph Neural Networks for Parametric Virtual Try-On.
Raquel Vidaurre, Igor Santesteban, Elena Garces, Dan Casas.
ACM MM 2020. [PDF] [Project]

Towards Photo-Realistic Virtual Try-On by Adaptively Generating Preserving Image Content.
Han Yang, Ruimao Zhang, Xiaobao Guo, Wei Liu, Wangmeng Zuo, Ping Luo.
CVPR 2020. [PDF] [Code]

PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfer.
Wentao Jiang, Si Liu, Chen Gao, Jie Cao, Ran He, Jiashi Feng, Shuicheng Yan.
CVPR 2020. [PDF]

GarmentGAN: Photo-realistic Adversarial Fashion Transfer.
Amir Hossein Raffiee, Michael Sollami.
ICPR 2020. [PDF]

SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On.
Surgan Jandial, Ayush Chopra, Kumar Ayush, Mayur Hemani, Abhijeet Kumar, Balaji Krishnamurthy.
WACV 2020. [PDF] [Code]

TailorGAN: Making User-Defined Fashion Designs.
Lele Chen, Justin Tian, Guo Li, Cheng-Haw Wu, Erh-Kan King, Kuan-Ting Chen, Shao-Hang Hsieh.
WACV 2020. [PDF] [Code]

ClothFlow: A Flow-Based Model for Clothed Person Generation.
Xintong Han, Xiaojun Hu, Weilin Huang, Matthew R. Scott.
ICCV 2019. [PDF]

VTNFP: An Image-Based Virtual Try-On Network With Body and Clothing Feature Preservation.
Ruiyun Yu, Xiaoqi Wang, Xiaohui Xie.
ICCV 2019. [PDF]

Toward Characteristic-Preserving Image-based Virtual Try-On Network.
Bochao Wang, Huabin Zheng, Xiaodan Liang, Yimin Chen, Liang Lin, Meng Yang.
ECCV 2018. [PDF]

Generating High-Resolution Fashion Model Images Wearing Custom Outfits.
Gökhan Yildirim, Nikolay Jetchev, Roland Vollgraf, Urs Bergmann.
ICCV Workshop on Computer Vision for Fashion, Art and Design 2019. [PDF]

Dress Code: High-Resolution Multi-Category Virtual Try-On.
Davide Morelli, Matteo Fincato, Marcella Cornia, Federico Landi, Fabio Cesari, Rita Cucchiara.
CVPR 2022 Workshop. [PDF] [Code] [Data]

PICTURE: PhotorealistIC Virtual Try-on from UnconstRained dEsigns.
Shuliang Ning, Duomin Wang, Yipeng Qin, Zirong Jin, Baoyuan Wang, Xiaoguang Han.
arXiv 2023. [PDF] [Project]

Human Body Reshaping

Structure-Aware Flow Generation for Human Body Reshaping.
Jianqiang Ren, Yuan Yao, Biwen Lei, Miaomiao Cui, Xuansong Xie.
CVPR 2022. [PDF] [Code]

Real-Time Reshaping of Humans.
Michal Richter, Kiran Varanasi, Nils Hasler, Christian Theobalt.
International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission, 2012. [PDF]

MovieReshape: Tracking and Reshaping of Humans in Videos.
Arjun Jain, Thorsten Thormählen, Hans-Peter Seidel, Christian Theobalt.
SIGGRAPH Asia 2010. [PDF] [Project]

Parametric reshaping of human bodies in images.
Shizhe Zhou, Hongbo Fu, Ligang Liu, Daniel Cohen-Or, Xiaoguang Han.
SIGGRAPH 2010. [PDF]

Scene context-aware Human Body Generation

Putting People in Their Place: Affordance-Aware Human Insertion Into Scenes.
Sumith Kulal, Tim Brooks, Alex Aiken, Jiajun Wu, Jimei Yang, Jingwan Lu, Alexei A. Efros, Krishna Kumar Singh.
CVPR 2023. [PDF] [Project]

Generating 3D People in Scenes Without People.
Yan Zhang, Mohamed Hassan, Heiko Neumann, Michael J. Black, Siyu Tang.
CVPR 2020. [PDF] [Code]

Human Mesh Recovery

GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras.
Ye Yuan, Umar Iqbal, Pavlo Molchanov, Kris Kitani, Jan Kautz.
CVPR 2022 (Oral). [PDF] [Project] [Code]

Shapy: Accurate 3D Body Shape Regression Using Metric and Semantic Attributes.
Vasileios Choutas, Lea Muller, Chun-Hao P. Huang, Siyu Tang, Dimitrios Tzionas, Michael J. Black.
CVPR 2022. [PDF] [Project] [Code]

PoseScript: 3D Human Poses from Natural Language.
Ginger Delmas, Philippe Weinzaepfel, Thomas Lucas, Francesc Moreno-Noguer, Grégory Rogez.
ECCV 2022. [PDF] [Code]

Human-Centric Perception

Versatile Multi-Modal Pre-Training for Human-Centric Perception.
Fangzhou Hong, Liang Pan, Zhongang Cai, Ziwei Liu.
CVPR 2022. [PDF] [Code] [Project]

Challenge and workshop

• KDD Workshop on Fashion. [2019] [2018] [2017] [2016]
• Workshop on Computer Vision for Fashion, Art and Design. [CVPR 2020] [ICCV 2019] [ECCV 2018] [ICCV 2017]
• NeurlPS workshop on Machine Learning for Creativity and Design. [2019] [2018] [2017]
• SIGIR Workshop On eCommerce. [2019] [2018] [2017]
• CVPR Deep Learning for Content Creation Tutorial. [2019]
• iMaterialist Fashion Challenge. [CVPR 2019]
• iDesigner Challenge. [CVPR 2019]
• FashionGen Challenge. [ICCV 2019, ECCV 2018]
• JD AI Fashion Challenge. [ChinaMM 2018]
• Alibaba FashionAI Global Challenge. [Tianchi]
• Artificial Intelligence on Fashion and Textile Conference. [AIFT 2018]
• Fashion IQ Challenge. [CVPR 2020] [ICCV 2019]
• DeepFashion2 Challenge. [CVPR 2020] [ICCV 2019]

Datasets

• Fashionpedia. [Website]
• DeepFashion2 Dataset. [Website]
• DeepFashion Dataset. [Website]
• FashionGen. [Website]
• FashionAI. [Tianchi]
• TaobaoClothMatch. [Tianchi]
• Fashion-MNIST. [Fashion-MNIST]
• Fashion IQ. [Website]
• NTURGBD-Parsing-4K Dataset. [Website]

Garment Design

Knitting 4D Garment with Elasticity Controlled for Body Motion.
Zishun Liu, Xingjian Han, Yuchen Zhang, Xiangjia Chen, Yukun Lai, Eugeni L. Doubrovski, Emily Whiting, Charlie C.L. Wang.
TOG 2021. [PDF] [Project]

Garment Design with Generative Adversarial Networks.
Chenxi Yuan, Mohsen Moghaddam.
KDD workshop on AdvML 2020. [PDF]

Fashion Style Influences

From Paris to Berlin: Discovering Fashion Style Influences Around the World.
Ziad Al-Halah, Kristen Grauman.
CVPR 2020. [PDF]

From Culture to Clothing: Discovering the World Events Behind A Century of Fashion Images.
Wei-Lin Hsiao, Kristen Grauman.
ICCV 2021. [PDF]

Team and People

• Real Virtual Humans, Max Planck Institute for Informatics, by Gerard Pons-Moll.
• Perceiving Systems, Tubingen Compus, Max Planck Institute for Intelligent Systems, by Michael Black.
• Visual Computer Lab, Technical University Munich (TUM), by Prof. Dr. Matthias Nießner and his team.
• Broadband Network and Digital Media Lab, Department of Automation, Tsinghua University, by Yebin Liu.
• Vision and Graphics Lab, University of Southern California, by Hao Li.

Dataset

• SMPL. To download the SMPL-X, SMPL+H and SMPL (Male and Female, Gender Neural Model) model, go to this project website and register to get access to the downloads section. [Code]

• THUmanDataset. THUman is a 3D real-world human model dataset containing approximately 7000 models.

• AGORA. AGORA, proposed at CVPR 2021 paper, consists of 4240 scans spanning more than 350 unique subjects, all paired with SMPL-X fits.

Applications

Fitness Training

AIFit: Automatic 3D Human-Interpretable Feedback Models for Fitness Training.
Mihai Fieraru, Mihai Zanfir, Silviu-Cristian Pirlea, Vlad Olaru, Cristian Sminchisescu.
CVPR 2021. [PDF] [Project]