Officially unofficial re-implementation of paper: Paint Transformer: Feed Forward Neural Painting with Stroke Prediction, ICCV 2021.
[Paper] [Official Paddle Implementation] [Huggingface Gradio Demo] [Unofficial PyTorch Re-Implementation] [Colab]
This repository contains the officially unofficial PyTorch re-implementation of paper:
Paint Transformer: Feed Forward Neural Painting with Stroke Prediction,
Songhua Liu*, Tianwei Lin*, Dongliang He, Fu Li, Ruifeng Deng, Xin Li, Errui Ding, Hao Wang (* indicates equal contribution)
ICCV 2021 (Oral)
Clone this repository:
git clone https://github.com/Huage001/PaintTransformer
cd PaintTransformer
Download pretrained model from Google Drive and move it to inference directory:
mv [Download Directory]/model.pth inference/
cd inference
Inference:
python inference.py
Train:
Before training, start visdom server:
python -m visdom.server
Then, simply run:
cd train
bash train.sh
You can monitor training status at http://localhost:8097/ and models would be saved at checkpoints/painter folder.
You may feel free to try other training options written in train.sh.
Input | Animated Output |
---|---|
If you find ideas or codes useful for your research, please cite:
@inproceedings{liu2021paint,
title={Paint Transformer: Feed Forward Neural Painting with Stroke Prediction},
author={Liu, Songhua and Lin, Tianwei and He, Dongliang and Li, Fu and Deng, Ruifeng and Li, Xin and Ding, Errui and Wang, Hao},
booktitle={Proceedings of the IEEE International Conference on Computer Vision},
year={2021}
}