Attention-based Fusion Router for RGBT Tracking. arXiv

We use the LasHeR training set for training, GTOT, RGBT210, RGBT234, LasHeR testing set, VTUAVST for testing, and their project addresses are as follows:

• GTOT
• RGBT210
• RGBT234
• LasHeR
• VTUAV

Clone repo:

git clone https://github.com/Alexadlu/AFter.git
cd AFter

Our code is trained and tested with Python == 3.8, PyTorch == 1.8.1 and CUDA == 11.2 on NVIDIA GeForce RTX 4090, you may use a different version according to your GPU.

conda create -n after python=3.8.13
conda activate after
pip install -r requirements.txt

1. Modify the project path and dataset path in $PROJECT_ROOT$/ltr/admin/local.py.
2. Download ToMP-50 pretrained weights and put it under $PROJECT_ROOT$/ltr/models/pretrained.
3. Run the following command.

python ltr/run_training.py --train_module tomp --train_name tomp50_v1

1. Modify the dataset path in $PROJECT_ROOT$/pytracking/evaluation/environment.py
2. Put the checkpoint into $PROJECT_ROOT$/pytracking/networks and select the checkpoint name in $PROJECT_ROOT$/pytracking/parameter/tomp/tomp50.py. Or just modify the checkpoint path in $PROJECT_ROOT$/pytracking/parameter/tomp/tomp50.py.
3. Run the following command.

python pytracking/run_tracker.py --tracker_name tomp --tracker_param tomp50 --runid 8600 --dataset_name lashertestingset

Our project is based on the pytracking framework and ToMP. Thanks for their contributions which help us to quickly implement our ideas.