The Vid2DensePose is a powerful tool designed for applying the DensePose model to videos, generating detailed "Part Index" visualizations for each frame. This tool is exceptionally useful for enhancing animations, particularly when used in conjunction with MagicAnimate for temporally consistent human image animation.
To utilize this tool, ensure the installation of:
Clone the repository:
git clone https://github.com/Flode-Labs/vid2densepose.git
Install necessary Python packages:
pip install -r requirements.txt
Clone the Detectron repository:
git clone https://github.com/facebookresearch/detectron2.git
Run the script:
python main.py -i sample_videos/input_video.mp4 -o sample_videos/output_video.mp4
The script processes the input video and generates an output with the densePose format.
You can also use the Gradio to run the script with an interface. To do so, run the following command:
For integration with MagicAnimate:
Special thanks to:
For any inquiries or support, please file an issue in our GitHub repository's issue tracker.