A Curated List of Awesome Virtual Try-on (VTON) Research!

A curated list of awesome research papers, projects, code, datasets, workshops, etc. related to virtual try-on (VTON).

• Prompt-based Virtual Try-on
• Image-based (2D) Virtual Try-on
• 3D Virtual Try-on
• Mix-and-match Virtual Try-On
• In-the-wild Virtual Try-On
• Multi-Pose Guided Virtual Try-on
• Video Virtual Try-on
• Non-clothing Virtual Try-on
• Pose-Guided Human Synthesis
• Datasets for Virtual Try-on
• Related Conference Workshops
• Demos
• Related Repositories

Prompt-based Virtual Try-on

ControlNet

• ControlNet - Hint: Use the clothing image as the image input and provide the human description in the text prompt or vice versa.
• EditAnything - Hint: Use a reference fashion image as input and provide your desired changes in the text prompt.

Stable-Diffusion

• Stable-DreamFusion - Hint: Use the Image-conditioned 3D Generation option to edit your fashion images.
• ThreeStudio - Hint: Use different models for generating output from the image-conditioned text prompts for fashion image editing.

Image-based (2D) Virtual Try-on

CVPR 2024

• StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On - Project, Code/Data/Model

AAAI 2024

• Towards Squeezing-Averse Virtual Try-On via Sequential Deformation - Paper, Code

WACV 2024

• Wearing the Same Outfit in Different Ways -- A Controllable Virtual Try-on Method - Paper
• GC-VTON: Predicting Globally Consistent and Occlusion Aware Local Flows with Neighborhood Integrity Preservation for Virtual Try-on - Paper

ICCV 2023

• Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing - Paper, Code
• Size Does Matter: Size-aware Virtual Try-on via Clothing-oriented Transformation Try-on Network - Paper, Code
• Virtual Try-On with Pose-Garment Keypoints Guided Inpainting - Paper, Code

CVPR 2023

• GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learning - Paper, Code, Project
• Linking Garment with Person via Semantically Associated Landmarks for Virtual Try-On - Paper
• TryOnDiffusion: A Tale of Two UNets - Paper, Project

NeurIPS 2022

• Towards Hard-pose Virtual Try-on via 3D-aware Global Correspondence Learning - Paper, Project

WACV 2022

• C-VTON: Context-Driven Image-Based Virtual Try-On Network - Paper, Code/Model/Data

ECCV 2022

• Dress Code: High-Resolution Multi-Category Virtual Try-On - Paper, Code/Data
• High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditions - Paper, Code/Model
• Single Stage Virtual Try-on via Deformable Attention Flows - Paper, Code/Model

CVPR 2022

• Full-Range Virtual Try-On with Recurrent Tri-Level Transform - Paper, Project
• Style-Based Global Appearance Flow for Virtual Try-On - Paper, Code/Model
• Weakly Supervised High-Fidelity Clothing Model Generation - Paper, Code/Model
• Dressing in the Wild by Watching Dance Videos - Paper, Project

CVPRW 2022

• Dual-Branch Collaborative Transformer for Virtual Try-On - Paper
• Dress Code: High-Resolution Multi-Category Virtual Try-On - Paper, Code/Data

ICCV 2021

• Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing - Paper, Code, Colab
• ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priors - Paper
• FashionMirror: Co-attention Feature-remapping Virtual Try-on with Sequential Template Poses - Paper

CVPR 2021

• Parser-Free Virtual Try-on via Distilling Appearance Flows - Paper, Code/Data/Model
• VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization - Paper, Code/Model
• Disentangled Cycle Consistency for Highly-realistic Virtual Try-On - Paper, Code/Data/Model
• Toward Accurate and Realistic Outfits Visualization with Attention to Details - Paper, Demo

ACCV 2020

• CloTH-VTON: Clothing Three-dimensional reconstruction for Hybrid image-based Virtual Try-ON - Paper, Project

ECCV 2020

• Do Not Mask What You Do Not Need to Mask: a Parser Free Virtual Try-On - Paper

CVPR 2020

• Towards Photo-Realistic Virtual Try-On by Adaptively Generating↔Preserving Image Content - Paper/Code/Data
• Image Based Virtual Try-On Network From Unpaired Data - Paper
• Semantically Multi-modal Image Synthesis - Paper/Code/Model

CVPRW 2020

• CP-VTON+: Clothing Shape and Texture Preserving Image-Based Virtual Try-On - Paper/Code/Data/Model
• 3D Reconstruction of Clothes using a Human Body Model and its Application to Image-based Virtual Try-On - Paper/Project

ICCV 2019

• VTNFP: An Image-Based Virtual Try-On Network With Body and Clothing Feature Preservation - Paper
• ClothFlow: A Flow-Based Model for Clothed Person Generation - Paper

ICCVW 2019

• UVTON: UV Mapping to Consider the 3D Structure of a Human in Image-Based Virtual Try-On Network, Paper
• LA-VITON: A Network for Looking-Attractive Virtual Try-On - Paper
• Robust Cloth Warping via Multi-Scale Patch Adversarial Loss for Virtual Try-On Framework - Paper
• Powering Virtual Try-On via Auxiliary Human Segmentation Learning - Paper
• Generating High-Resolution Fashion Model Images Wearing Custom Outfits - Paper

ECCV 2018

• Toward Characteristic-Preserving Image-based Virtual Try-On Network - Paper, Code
• SwapNet: Garment Transfer in Single View Images - Paper, Code (community contribution)

CVPR 2018

• VITON: An Image-based Virtual Try-on Network - Paper, Code/Model

Others

• IDM-VTON: Improving Diffusion Models for Authentic Virtual Try-on in the Wild - Demo, Paper, Project
• OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on - Code
• Outfit Anyone: Ultra-high quality virtual try-on for Any Clothing and Any Person - Project
• Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images -Paper, Data
• StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On - Paper, Code
• CAT-DM: Controllable Accelerated Virtual Try-on with Diffusion Model - Paper, Project
• FICE: Text-Conditioned Fashion Image Editing With Guided GAN Inversion - Paper, Code
• OccluMix: Towards De-Occlusion Virtual Try-on by Semantically-Guided Mixup, TMM 2023 - Paper, Code
• Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance Flow, ACM Multimedia 2023 - Paper, Code
• LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On, ACM Multimedia 2023 - Paper, Code
• Limb-Aware Virtual Try-On Network with Progressive Clothing Warping, IEEE Multimedia 2023 - Paper
• FashionTex: Controllable Virtual Try-on with Text and Texture, SIGGRAPH 2023 - Paper
• DreamPaint: Few-Shot Inpainting of E-Commerce Items for Virtual Try-On without 3D Modeling - Paper
• PG-VTON: A Novel Image-Based Virtual Try-On Method via Progressive Inference Paradigm - Paper, Code
• Fill in Fabrics: Body-Aware Self-Supervised Inpainting for Image-Based Virtual Try-On, BMVC 2022 - Paper, Code/Model/Data
• Probing TryOnGAN, CODS-COMAD 2022 - Paper
• FitGAN: Fit- and Shape-Realistic Generative Adversarial Networks for Fashion - Paper
• Spatial Transformation for Image Composition via Correspondence Learning - Paper
• PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-on - Paper
• Significance of Skeleton-based Features in Virtual Try-On - Paper
• You can try without visiting: a comprehensive survey on virtually try-on outfits, Multimedia Tools and Applications - Paper
• High fidelity virtual try-on network via semantic adaptation and distributed componentization, Computational Visual Media 2022 - Paper
• St-Vton: Self-Supervised Vision Transformer for Image-Based Virtual Try-On - Paper
• Photo-Realistic Virtual Try-On with Enhanced Warping Module, Advances in Intelligent Systems and Computing 2022 - Paper
• Virtual Try-On Using Augmented Reality - Paper
• WG-VITON: Wearing-Guide Virtual Try-On for Top and Bottom Clothes - Paper
• VTNCT: an image-based virtual try-on network by combining feature with pixel transformation, The Visual Computer 2022 - Paper
• RMGN: A Regional Mask Guided Network for Parser-free Virtual Try-on, IJCAI-ECAI 2022 - Paper, Code/Model/Data
• A Flow-Based Generative Network for Photo-Realistic Virtual Try-On, IEEE Access 2022 - Paper, Code/Model/Data
• An Efficient Style Virtual Try on Network for Clothing Business Industry - Paper
• Cross-category Virtual Try-on Technology Research Based on PF-AFN, ICVIP 2021 - Paper
• Virtual Try-on Network With Attribute Transformation and Local Rendering, IEEE TRANSACTIONS ON MULTIMEDIA, 2021 - Paper
• Transform, Warp, and Dress: A New Transformation-guided Model for Virtual Try-on, ACM Trans. Multimedia Comput. Commun. Appl. 2022 - Paper
• Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN, NeurIPS 2021. - Paper
• Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing - Paper
• PT-VTON: an Image-Based Virtual Try-On Network with Progressive Pose Attention Transfer - Paper
• Data Augmentation using Random Image Cropping for High-resolution Virtual Try-On (VITON-CROP) - Paper
• Per Garment Capture and Synthesis for Real-time Virtual Try-on, UIST 2021 - Paper, Project
• WAS-VTON: Warping Architecture Search for Virtual Try-on Network - Paper, Code/Model
• Shape Controllable Virtual Try-on for Underwear Models - Paper
• Cloth Interactive Transformer for Virtual Try-On - Paper, Code/Model
• CloTH-VTON+: Clothing Three-dimensional reconstruction for Hybrid image-based Virtual Try-ON, IEEE Access 2021 - Paper, Project
• VITON-GT: An Image-based Virtual Try-On Model with Geometric Transformations, ICPR 2020 - Paper
• TryOnGAN: Body-Aware Try-On via Layered Interpolation, SIGGRAPH 2021 - Paper/Project
• VOGUE: Try-On by StyleGAN Interpolation Optimization - Paper/Project
• Deep Virtual Try-on with Clothes Transform, ICS 2018 - Paper, Code
• NDNet: Natural Deformation Of Apparel For Better Virtual Try-On Experience, ACM SAC 2021
• Keypoints-Based 2D Virtual Try-on Network System, JAKO 2020 - Paper
• Virtual Try-On With Generative Adversarial Networks: A Taxonomical Survey - Book chapter
• LGVTON: A Landmark Guided Approach to Virtual Try-On - Paper, Code
• SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On, WACV 2020 - Paper, Code/Model (community contribution)
• GarmentGAN: Photo-realistic Adversarial Fashion Transfer - Paper
• Toward Accurate and Realistic Virtual Try-on Through Shape Matching and Multiple Warps - Paper
• FashionFit Analysis of Mapping 3D Pose and neural body fit for custom virtual try-on, IEEE Access 2020 - Paper
• Inpainting-Based Virtual Try-on Network for Selective Garment Transfer, IEEE Access 2019 - Paper
• SP-VITON: shape-preserving image-based virtual try-on network, Multimedia Tools and Applications 2019 - Paper
• VITON-GAN: Virtual Try-on Image Generator Trained with Adversarial Loss, Eurographics 2019 Posters - Paper, Code/Model
• Image-Based Virtual Try-on Network with Structural Coherence, ICIP 2019 - Paper
• End-to-End Learning of Geometric Deformations of Feature Maps for Virtual Try-On - Paper
• M2E-Try On Net: Fashion from Model to Everyone - Paper

3D Virtual Try-on

NeurIPS 2022

• ULNeF: Untangled Layered Neural Fields for Mix-and-Match Virtual Try-On - Paper, Project

WACV 2022

• Robust 3D Garment Digitization from Monocular 2D Images for 3D Virtual Try-On Systems - Paper

ICCV 2021

• M3D-VTON: A Monocular-to-3D Virtual Try-On Network - Paper, Code

CVPR 2021

• Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On - Paper, Project, Code

ECCV 2020

• BCNet: Learning Body and Cloth Shape from A Single Image - Paper, Code/Data
• GAN-based Garment Generation Using Sewing Pattern Images - Paper/Code/Model/Data
• Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images - Paper/Data
• SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothing - Paper/Code/Data
• CLOTH3D: Clothed 3D Humans - Paper

CVPR 2020

• Learning to Transfer Texture from Clothing Images to 3D Humans - Paper/Code
• TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style - Paper/Code/Data
• Learning to Dress 3D People in Generative Clothing - Paper/Code/Data

ICCV 2019

• Multi-Garment Net: Learning to Dress 3D People from Images - Paper/Code/Data
• 3DPeople: Modeling the Geometry of Dressed Humans - Paper
• GarNet: A Two-Stream Network for Fast and Accurate 3D Cloth Draping - Paper/Data

ECCV 2018

• DeepWrinkles: Accurate and Realistic Clothing Modeling - Paper

CVPR 2018

• Video Based Reconstruction of 3D People Models - Paper/Code/Data

Others

• DM-VTON: Distilled Mobile Real-time Virtual Try-On, ISMAR 2023 - Paper, Code
• Three stages of 3D virtual try-on network with appearance flow and shape field, The Visual Computer 2023 - Paper
• Robust 3D Garment Digitization from Monocular 2D Images for 3D Virtual Try-On Systems, 2021 - Paper
• REALISTIC MONOCULAR-TO-3D VIRTUAL TRY-ON VIA MULTI-SCALE CHARACTERISTICS CAPTURE, ICASSP 2022 - Paper
• Point-Based Modeling of Human Clothing - Paper
• CloTH-VTON+: Clothing Three-dimensional reconstruction for Hybrid image-based Virtual Try-ON, IEEE Access 2021 - Paper, Project
• Physically Based Neural Simulator for Garment Animation - Paper
• GarNet++: Improving Fast and Accurate Static3D Cloth Draping by Curvature Loss, IEEE T-PAMI, 2020 - Paper
• DeepCloth: Neural Garment Representation for Shape and Style Editing - Paper
• CloTH-VTON: Clothing Three-dimensional reconstruction for Hybrid image-based Virtual Try-ON, ACCV 2020 - Paper, Project
• Fully Convolutional Graph Neural Networks for Parametric Virtual Try-On, ACM SCA 2020 - Paper/Project
• DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animation - Paper
• 3D Reconstruction of Clothes using a Human Body Model and its Application to Image-based Virtual Try-On, CVPRW 2020 - Paper/Project
• Learning-Based Animation of Clothing for Virtual Try-On, Eurographics 2019 - Paper/Project, Code
• Learning an Intrinsic Garment Space for Interactive Authoring of Garment Animation, SIGGRAPH Asia 2019 - Paper/Code
• 3D Virtual Garment Modeling from RGB Images, ISMAR 2019 - Paper
• Deep Garment Image Matting for a Virtual Try-on System, ICCVW 2019 - Paper
• Learning a Shared Shape Space for Multimodal Garment Design, SIGGRAPH Asia 2018 - Paper/Code/Data
• Detailed Garment Recovery from a Single-View Image, ACM TOG 2018 - Paper
• ClothCap: Seamless 4D Clothing Capture and Retargeting, SIGGRAPH 2017 - Paper
• Virtual Try-On through Image-Based Rendering, IEEE T-VCG 2013 - Paper
• Markerless Garment Capture, ACM TOG 2008 - Paper/Data

Mix-and-match Virtual Try-on

• Wearing the Same Outfit in Different Ways -- A Controllable Virtual Try-on Method, WACV 2024 -Paper
• Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing, ICCV 2021 -Paper, Code, Colab
• Toward Accurate and Realistic Outfits Visualization with Attention to Details, CVPR 2021 -Paper
• Image Based Virtual Try-on Network from Unpaired Data, CVPR 2020 - Paper, Code

In-the-wild Virtual Try-on

• Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images -Paper, Data
• Dressing in the Wild by Watching Dance Videos, CVPR 2022 - Paper, Project

Multi-Pose Guided Virtual Try-on

• CF-VTON: Multi-Pose Virtual Try-on with Cross-Domain Fusion, ICASSP 2023 - Paper
• Multiple Pose Virtual Try-On Based on 3D Clothing Reconstruction, IEEE Access 2021 - Paper
• SPG-VTON: Semantic Prediction Guidance for Multi-pose Virtual Try-on - Paper
• Down to the Last Detail: Virtual Try-on with Fine-grained Details, ACM MM 2020 - Paper, Code/Model, ArXiv
• Towards Multi-pose Guided Virtual Try-on Network, ICCV 2019 - Paper, Code
• FIT-ME: IMAGE-BASED VIRTUAL TRY-ON WITH ARBITRARY POSES, ICIP 2019 - Paper
• Virtually Trying on New Clothing with Arbitrary Poses, ACM MM 2019 - Paper
• FashionOn: Semantic-guided Image-based Virtual Try-on with Detailed Human and Clothing Information, ACM MM 2019 - Paper

Video Virtual Try-on

• ClothFormer: Taming Video Virtual Try-on in All Module, CVPR 2022 - Paper, Code, Project
• MV-TON: Memory-based Video Virtual Try-on network, ACM MM 2021 - Paper
• ShineOn: Illuminating Design Choices for Practical Video-based Virtual Clothing Try-on, WACV 2021 Workshop - Project/Paper/Code
• FW-GAN: Flow-Navigated Warping GAN for Video Virtual Try-On, ICCV 2019 - Paper
• Unsupervised Image-to-Video Clothing Transfer, ICCVW 2019 - Paper
• Garment Replacement in Monocular Video Sequences, ACM TOG 2014 - Paper

Video-to-Image Virtual Try-on

• DPV-VTON : Detail-Preserving Video-based Virtual Try-On, ICMIP 2023 - Paper

Non-clothing Virtual Try-on

• Real-time Virtual-Try-On from a Single Example Image through Deep Inverse Graphics and Learned Differentiable Renderers, EUROGRAPHICS 2022 - Paper
• ARShoe: Real-Time Augmented Reality Shoe Try-on System on Smartphones, ACM Multimedia 2021 - Paper
• Deep Graphics Encoder for Real-Time Video Makeup Synthesis from Example, CVPRW 2021 - Paper
• FITTINTM - Online 3D Shoe Try-on, 3DBODY.TECH 2020 - Paper
• CA-GAN: Weakly Supervised Color Aware GAN for Controllable Makeup Transfer - Paper
• Regularized Adversarial Training for Single-Shot Virtual Try-On, ICCVW 2019 - Paper
• Disentangled Makeup Transfer with Generative Adversarial Network - Paper
• PIVTONS: Pose Invariant Virtual Try-On Shoe with Conditional Image Completion, ACCV 2018 - Paper
• Virtual Try-on of Eyeglasses using 3D Model of the Head - Paper
• A MIXED REALITY SYSTEM FOR VIRTUAL GLASSES TRY-ON - Paper
• A virtual try-on system in augmented reality using RGB-D cameras for footwear personalization - Paper

Pose-Guided Human Synthesis

• Cross Attention Based Style Distribution for Controllable Person Image Synthesis, ECCV 2022 - Paper
• InsetGAN for Full-Body Image Generation, CVPR 2022. - Paper, Project
• Dressing in the Wild by Watching Dance Videos, CVPR 2022 - Paper, Project
• Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGAN, SIGGRAPH Asia 2021 - Paper, Project
• PoNA: Pose-Guided Non-Local Attention for Human Pose Transfer, IEEE T-IP 2020 - Paper
• Pose-Guided High-Resolution Appearance Transfer via Progressive Training - Paper
• Recapture as You Want - Paper
• Generating Person Images with Appearance-aware Pose Stylizer, IJCAI 2020 - Paper, Code
• Controllable Person Image Synthesis with Attribute-Decomposed GAN, CVPR 2020 - Paper, Code
• Deep Image Spatial Transformation for Person Image Generation, CVPR 2020 - Paper, Code
• Neural Pose Transfer by Spatially Adaptive Instance Normalization, CVPR 2020 - Paper, Code
• Guided Image-to-Image Translation with Bi-Directional Feature Transformation, ICCV 2019 - Paper, Code
• Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesis, ICCV 2019 - Paper, Code
• ClothFlow: A Flow-Based Model for Clothed Person Generation, ICCV 2019 - Paper
• Progressive Pose Attention for Person Image Generation, CVPR 2019 - Paper, Code
• Dense Intrinsic Appearance Flow for Human Pose Transfer, CVPR 2019 - Paper, Code
• Unsupervised Person Image Generation with Semantic Parsing Transformation, CVPR 2019, TPAMI 2020 - Paper, Code
• Pose Guided Fashion Image Synthesis Using Deep Generative Model - Paper
• Synthesizing Images of Humans in Unseen Poses, CVPR 2018 - Paper, Code
• Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesis, NeurIPS 2018 - Paper
• Deformable GANs for Pose-based Human Image Generation, CVPR 2018 - Paper
• Pose-Normalized Image Generation for Person Re-identification, ECCV 2018 - Paper
• Disentangled Person Image Generation, CVPR 2018 - Paper/Code/Data
• A Variational U-Net for Conditional Appearance and Shape Generation, CVPR 2018 - Paper, Code
• Human Appearance Transfer, CVPR 2018 - Paper
• Pose guided person image generation, NeurIPS 2017 - Paper, Code

Datasets for Virtual Try-on

• StreetTryOn - Download
• CLOTH4D, CVPR 2023 - Download
• DressCode - Download, Paper
• VITON-HD - Download, Project
• VITON - Download, Paper
• MPV - Download, Paper
• Deep Fashion3D - Paper
• DeepFashion MultiModal - Download
• Digital Wardrobe - Download/Paper/Project
• TailorNet Dataset - Download, Project
• CLOTH3D - Paper
• 3DPeople - Project
• THUman Dataset - Project
• Garment Dataset, Wang et al. 2018 - Project

Related Conference Workshops

• Workshop on Computer Vision for Fashion, Art and Design: CVPR 2022, CVPR 2021, CVPR 2020, ICCV 2019, ECCV 2018
• Workshop on Towards Human-Centric Image/Video Synthesis: CVPR 2020, CVPR 2019

Demos

• Outfit Anyone-in-the-Wild - Demo, Docs
• Outfit Anyone - Demo, Docs
• Looklet Dressing Room Business, Demo
• TINT platform for virtual try-on of everything face-related (makeup, glasses, earrings, jewelry, etc.) Business, Demo.

Related Repositories

• awesome-fashion-ai
• Cool Fashion Papers
• Clothes-3D
• Awesome 3D Human
• Awesome 3D reconstruction list
• Human Body Reconstruction
• Awesome 3D Body Papers
• Awesome pose transfer

Pull requests are welcome!