1. ROS noetic
OS: ubuntu 20.04 LTS
# example
rosbag info t1.bag
rosbag play t1.bag --pause
rosbag record /camera/color/image_raw /camera/imu
# example
rostopic list # list all topics
rviz
- undistorted the images and videos
3. Kalibr
-
Multiple camera calibration: support monocular camera calibration
rosrun kalibr kalibr_calibrate_cameras \
--target /data/april_6x6_insta.yaml \
--bag /data/insta_cali.bag \
--models pinhole-radtan \
--topics /camera/color/image_raw
- Camera-IMU calibration: get transformation from camera to imu (body frame)
rosrun kalibr kalibr_calibrate_imu_camera \
--target april_6x6_insta.yaml \
--imu imu.yaml \
--imu-models calibrated \
--cam t1-camchain.yaml \
--bag t1.bag
- Multi-IMU and IMU intrinsic calibration: get IMU intrinsic(accelerometer_noise_density, accelerometer_random_walk, gyroscope_noise_density, gyroscope_random_walk)
- bag_extractor: extract gray images and imu from bag
# example
rosrun kalibr kalibr_bagextractor --image-topics /camera/color/image_raw --imu-topics /camera/imu --bag t1.bag
roslaunch realsense2_camera rs_d455.launch
5.1 ORB_SLAM3
original version of ORB_SLAM3 INPUT(images) => OUTPUT(6D Pose + trajectory + map(feature points))
5.2 ORB_SLAM3_GO_PRO(use this project as main project)
Support GO PRO and insta one R
INPUT(videos) => OUTPUT(6D Pose + trajectory + map(feature points))
[UNVERIFIED] Make ORB_SLAM3 IMU initialize faster than original version
6.1 SuperPoint
6.2 SuperGlue
6.3 LightGlue
6.4 e2e_multi_view_matching (waiting for code)
6.5 ORB
7. Datasets
cam and cam-imu calibration
recorded in museum, 25 mins
recorded in PGR room