SiameseX.PyTorch

A simplified PyTorch implementation of Siamese networks for tracking: SiamFC, SiamVGG, SiamDW, SiamRPN, SiamRPN++.

Warning:  It is still in development, some files are just for the integrity of the project.

Dependencies

• python2.7

• pytorch == 0.4.0

• opencv

• mmcv

Currently supported models

• SiamFC

• SiamVGG

• SiamFCRes22

• SiamFCIncep22

• SiamFCNext22

• SiamRPN

• SiamRPNVGG

• SiamRPNRes22

• SiamRPNIncep22

• SiamRPNResNeXt22

• SiamRPN++

Backbones

• AlexNet

• VGG

• ResNet22

• Incep22

• ResNeXt22

• ResNet50

Demo

• Try SiamFC:

Clone this repo and run

python demo.py --model SiamFC

You can change --mdoel to other models like

python demo.py --model SiamFCNext22

• Try SiamRPN:

Download the pretrained model and put it in ./cp folder.

python demo_rpn.py --model SiamRPNResNeXt22

• Try SiamRPN++:

Download the pretrained model and put it in ./cp folder.

python demo_rpn.py --model SiamRPNPPRes50

Training

• download VID dataset (I did not use Youtube-bb because of limited resources).

• download label files from here and run label_preprocess.py --file --output_file --path to replace my file path by yours,  these three arguments should be treated carefully.

• train SiamFCNext22 tracker

python train.py --gpu 0 --config configs/SiamFC.py

• just replace --config argument and you can train other models

python train.py --gpu 0 --config configs/SiamRPN.py

TODO

We have accumulated the following to-do list, which we hope to complete in the near future

• Still to come:

• Add testing code on common datasets

• Add SiamRPN(AlexNet as backbone)

• Add SiamRPN(VGG as backbone)

• Add SiamRPN(ResNet, ResNext, Inception as backbone)

Citation

@inproceedings{bertinetto2016fully,
  title={Fully-convolutional siamese networks for object tracking},
  author={Bertinetto, Luca and Valmadre, Jack and Henriques, Joao F and Vedaldi, Andrea and Torr, Philip HS},
  booktitle={European conference on computer vision},
  pages={850--865},
  year={2016},
  organization={Springer}
}

@inproceedings{Li2019SiamVGGVT,
  title={SiamVGG: Visual Tracking using Deeper Siamese Networks},
  author={Yuhong Li and Xiaofan Zhang},
  year={2019}
}

@inproceedings{SiamDW_2019_CVPR,
    author={Zhang, Zhipeng and Peng, Houwen},
    title={Deeper and Wider Siamese Networks for Real-Time Visual Tracking},
    booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
    year = {2019}

@article{li2018siamrpn++,
  title={SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networks},
  author={Li, Bo and Wu, Wei and Wang, Qiang and Zhang, Fangyi and Xing, Junliang and Yan, Junjie},
  journal={arXiv preprint arXiv:1812.11703},
  year={2018}
}
}

References

• SiamVGG

• siamfc-pytorch

• SiamDW

• pysot

• DaSiamRPN