SiameseX.PyTorch

A simplified PyTorch implementation of Siamese networks for tracking: SiamFC, SiamVGG, SiamDW, SiamRPN, SiamRPN++.

Warning: It is still in development, some files are just for the integrity of the project.

Dependencies

• python2.7
• pytorch == 0.4.0
• opencv
• mmcv

Currently supported models

• SiamFC
  • SiamVGG
  • SiamFCRes22
  • SiamFCIncep22
  • SiamFCNext22
• SiamRPN
  • SiamRPNVGG
  • SiamRPNRes22
  • SiamRPNIncep22
  • SiamRPNResNeXt22
• SiamRPN++

Backbones

• AlexNet
• VGG
• ResNet22
• Incep22
• ResNeXt22
• ResNet50

Demo

• Try SiamFC:

Clone this repo and run

python demo.py --model SiamFC

You can change --mdoel to other models like

python demo.py --model SiamFCNext22

• Try SiamRPN:

Download the pretrained model and put it in ./cp folder.

python demo_rpn.py --model SiamRPNResNeXt22

• Try SiamRPN++:

Download the pretrained model and put it in ./cp folder.

python demo_rpn.py --model SiamRPNPPRes50

• You'll see the following:

Training

• download VID dataset (I did not use Youtube-bb because of limited resources).
• download label files from here and run label_preprocess.py --file --output_file --path to replace my file path by yours, these three arguments should be treated carefully.
• train SiamFCNext22 tracker

python train.py --gpu 0 --config configs/SiamFC.py

• just replace --config argument and you can train other models

python train.py --gpu 0 --config configs/SiamRPN.py

TODO

We have accumulated the following to-do list, which we hope to complete in the near future

• Still to come:
  • Add testing code on common datasets
  • Add SiamRPN(AlexNet as backbone)
  • Add SiamRPN(VGG as backbone)
  • Add SiamRPN(ResNet, ResNext, Inception as backbone)

Citation

@inproceedings{bertinetto2016fully,
  title={Fully-convolutional siamese networks for object tracking},
  author={Bertinetto, Luca and Valmadre, Jack and Henriques, Joao F and Vedaldi, Andrea and Torr, Philip HS},
  booktitle={European conference on computer vision},
  pages={850--865},
  year={2016},
  organization={Springer}
}

@inproceedings{Li2019SiamVGGVT,
  title={SiamVGG: Visual Tracking using Deeper Siamese Networks},
  author={Yuhong Li and Xiaofan Zhang},
  year={2019}
}

@inproceedings{SiamDW_2019_CVPR,
    author={Zhang, Zhipeng and Peng, Houwen},
    title={Deeper and Wider Siamese Networks for Real-Time Visual Tracking},
    booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
    year = {2019}

@article{li2018siamrpn++,
  title={SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networks},
  author={Li, Bo and Wu, Wei and Wang, Qiang and Zhang, Fangyi and Xing, Junliang and Yan, Junjie},
  journal={arXiv preprint arXiv:1812.11703},
  year={2018}
}
}

References

• SiamVGG
• siamfc-pytorch
• SiamDW
• pysot
• DaSiamRPN