Comments (12)
Hmm, looks like perhaps it's falling behind in processing... Can you show us your launch files and can you also upload the console output of voxblox?
from voxblox.
The output you posted seems to be from orb slam, could you please provide the output of voxblox as it would be interesting to see the timings, any transform related messages and the number of points being integrated.
from voxblox.
Sorry it is my fault. Launch file is still same.
try (copy).launch.txt
When rviz shows mesh but has delay, the output is like this.
ouput.txt
But just now when I try again, rviz fail to show anything. Output is as follow.
output1.txt
from voxblox.
The issue is with the transformation queue. I am a bit puzzled by whats going on though.
Searching through the logs for warnings the transforms seems to span from when the node was started to the current time and the pointclouds seem to be coming in the same range. Does your pose source also publish a tf, as its possible that may not have these same issues.
Alternatively it would help us debug if you could send us a short bag that has the issue.
from voxblox.
As for the publisher side, I think it also publish a tf.
But in launch, I already remap <remap from="transform" to="/orb_slam_2_ros_node/transform_cam" />
Just for reference, I uploaded the publisher code.
interface_rgbd (copy).txt
interface (copy).txt
I record this bag file and hope this can help.
https://drive.google.com/file/d/1MXOxdSvOF6z9c4-N7AN2hg6cXB9V-h_E/view?usp=sharing
This one fail to show anything in rviz. I use rosbag record -a
to record it.
And the output is as follow.
output1.txt
Plus, when I record rosbag, the terminal running roslaunch freenect_launch freenect.launch
kept outputing error
[ERROR] [1535380840.727341416]: cv_bridge exception: '[32FC1] is not a color format. but [bgr8] is. The conversion does not make sense'
[ERROR] [1535380840.745292403]: Cannot stream RGB and IR at the same time. Streaming RGB only.
[ERROR] [1535380840.805041228]: Compressed Depth Image Transport - Compression requires single-channel 32bit-floating point or 16bit raw depth images (input format is: bayer_grbg8).
I guess it is the problem of using rosbag record -a
. But I am not sure which topics are needed to debug, so I record all. If there is any need to record again, could you tell me which topics must be included?
from voxblox.
I had a look at the rosbag, unfortunately using rosbag info
revealed an issue. When you record with rosbag record -a it tries to record every topic including many that aren't usually generated unless there is a subscriber. For example it generates and records all the images 3 times with 3 different compression levels. Trying to record this much info causes it to drop most of the messages.
The only topics we need for debugging are the pointcloud and the transform topic. In your case these can be recorded via rosbag record /camera/depth_registered/points /orb_slam_2_ros_node/transform_cam
from voxblox.
This time I only record point cloud and transform.
https://drive.google.com/file/d/19V_AHNPz2t1ZgQxTk7EEYJSQbpdqEndH/view?usp=sharing
(I deleted previous comments) Please check and thxxxxxxxxx!
from voxblox.
I had a quick look and found the bag ran without issues on my laptop. However, I saw two possible issues.
-
The transforms generally arrive after the pointclouds and are at quite a different rate. We actually made changes to how we handle transforms last week that account for these issues. Make sure you have pulled and built the latest version of the voxblox master.
-
On my laptop the rate of pointclouds exceeded the integration rate causing it to fall behind and drop some data. To ensure I didn't hit this issue I just set
<param name="min_time_between_msgs_sec" value="0.1" />
to limit incoming data to 10 Hz
from voxblox.
Thank a lot. I changed voxblox into newest version and modified the launch file as you said. But my system still has large latency and sometimes it fails to show mesh in rviz. What could the problem be ?
from voxblox.
I believe the issue isn't that there is latency in the mesh, but that voxblox is not using the measurements and so not updating the map. It might still be an issue with voxblox falling behind, orbslam tends to be a serious resource hog, what is your cpu usage like when running?
from voxblox.
Thanks a lot!
It is because ORBSLAM2 use 100% CPU, voxblox fall off as a result. I changed the voxblox line to force it use 2 cores and the whole system perform well now.
from voxblox.
Thanks a lot!
It is because ORBSLAM2 use 100% CPU, voxblox fall off as a result. I changed the voxblox line to force it use 2 cores and the whole system perform well now.
What change did you make to solve this?
from voxblox.
Related Issues (20)
- How to convert to shape_msgs/Mesh?
- How to generate freespace pointcloud?
- build voxblox_ros error in ubuntu 20.04 / noetic HOT 1
- Performance (update speed)
- Catkin build error HOT 1
- Planning in confined space
- wrong in save_map
- libvoxblox_proto.so: undefined symbol
- Empty TSDF with projective tsdf integrator
- Is the reconstructed scene optimized when there is a loop closure?
- Proper way to query the created ESDF map?
- How can i use different dataset? (ex. ScanNet) HOT 1
- What is the truncation distance?
- Help running Voxblox on the Machine Hall dataset
- Possible memory alignment problem HOT 2
- Load TSDF map into Voxblox HOT 1
- Fast-lio & voxblox strange problem
- RGBD dataset can be downloaded HOT 1
- failed making grpc HOT 2
- build issue
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from voxblox.