Created by Lu Zhang, Institute of Automation, Chinese Academy of Science.

We propose a novel detector, called AR-CNN, that tackles the practical position shift problem in multispectral pedestrian detection. For more details, please refer to our paper.

The KAIST-Paired annotation is available through [Google Drive] and [BaiduYun]. If you have any problem, please feel free to contact me.

First of all, clone the code:

git clone https://github.com/luzhang16/AR-CNN.git

Then, create a folder:

cd $AR-CNN && mkdir data

• Python 2.7 or 3.6
• Pytorch 0.4.0
• CUDA 8.0 or higher

It is recommended to symlink the dataset root to $AR-CNN/data.

AR-CNN
├── cfgs
├── lib
├── data
│   ├── kaist-paired
│   │   ├── annotations
│   │   ├── images
│   │   ├── splits

KAIST dataset: Please follow the instructions in rgbt-ped-detection to prepare KAIST dataset.

KAIST-Paired annotation: Google Drive or BaiduYun.

Trainval & Test splits: mv $AR-CNN/splits/ $AR-CNN/data/kaist-paired/

We use VGG16 pretrained models in our experiments. You can download the model from:

• VGG16: Dropbox, VT Server

Download them and put them into the data/pretrained_model/.

As pointed out by ruotianluo/pytorch-faster-rcnn, choose the right -arch in make.sh file, to compile the CUDA code:

More details about setting the architecture can be found here or here

Install all the python dependencies using pip:

pip install -r requirements.txt

Compile the cuda dependencies using following simple commands:

cd lib
sh make.sh

It will compile all the modules you need, including NMS, ROI_Pooing, ROI_Align and ROI_Crop. The default version is compiled with Python 2.7, please compile by yourself if you are using a different python version.

As pointed out in this issue, if you encounter some error during the compilation, you might miss to export the CUDA paths to your environment.

If you want to get the detection results on KAIST "reasonable" test set, simply run:

python test_net.py --dataset kaist --net vgg16 \
                   --checksession $SESSION --checkepoch $EPOCH --checkpoint $CHECKPOINT \
                   --reasonable --cuda

Specify the specific model session, checkepoch and checkpoint, e.g., SESSION=1, EPOCH=3, CHECKPOINT=17783.

If you want to run with our pretrained model, download the pretrained model through Google Drive or BaiduYun (pwd: 3bxs).

You can use the evaluation script provided by the original KAIST dataset or this matlab evaluation tool: Google Drive or BaiduYun (pwd: 41qk)

If you want to get the detection results under the metric S, simply run:

sh test_shift.sh

If you want to get the detection results under certain position shift, simply run:

python test_net.py --dataset pascal_voc --net vgg16 \
                   --checksession $SESSION --checkepoch $EPOCH --checkpoint $CHECKPOINT \
                   --reasonable --cuda --sx 4 --sy -4

Note that sx and sy denote the pixels of position shift along x-axis and y-axis respectively.

We appreciate much the code faster-rcnn.pytorch developed by Jianwei Yang and Jiasen Lu. This code is built mostly based on it.