Issue when trying to launch yolov8 - using realsense camera about yolov8_ros HOT 10 CLOSED

Hey @abs90, that seems a problem with CUDA. Have you installed the Nvidia drivers?

from yolov8_ros.

Hey @mgonzs13 appreciate the fast response, that actually makes sense. I tried to use the cpu instead and it seems to work for non-3d yolo8v segmentation.

However, I installed my nvidia drivers, but still seem to face the same problem when launching the 3d yolo8v:

os2 launch yolov8_bringup yolov8_3d.launch.py model:=yolov8m-seg.pt device:=gpu

Will double check my Nvidia installation, any other tips you recommend looking at?

from yolov8_ros.

You should check the pytorch installation paying attention to the Nvidia driver supported by your torch's version. You may need to reinstall pytorch. Before running yolo with CUDA, you can check if torch has Nvidia support with the following Python code:

import torch
torch.cuda.is_available()

from yolov8_ros.

You should check the pytorch installation paying attention to the Nvidia driver supported by your torch's version. You may need to reinstall pytorch. Before running yolo with CUDA, you can check if torch has Nvidia support with the following Python code:

import torch
torch.cuda.is_available()

That actually seems to have fixed my issue with the Nvidia support and Python Code. Initially it was showing False when I ran the torch.cuda.is_available() command. But I uninstalled pytorch and re-installed, as well as installed cuda-toolkit. It appears that now using the default YOLOv8 model, I no longer need to specify CPU as the driver. However, as soon as I try to run the 3D YOLOv8 model, I don't see any results at all, even though the command executes okay.

I do see this message on my rqt log:

rqt_topic: Topic "/camera/camera/depth/color/points" has more than one type, choosing the first one of type sensor_msgs/msg/Image

No video shows on RVIZ for the 3D detection though.

Please let me know if there's any info that may help to diagnose this?

Thank you for your fast and helpful responses so far!

from yolov8_ros.

There are some topics you can use to diagnose. For instance, the /yolo/detections should have the detections of YOLOv8. Echo it to check if the objects are detected. Besides, you can use the rqt_graph to check if all nodes are subscribed to the correct topics.

from yolov8_ros.

@mgonzs13, I checked rqt and seems to nodes are subscribed correctly, and match what I see on the rqt graph in your example for the yolov8_3d.

Still investigating why I'm not seeing anything on the image on rviz when running: ros2 launch yolov8_bringup yolov8_3d.launch.py

Also, at least for now I can see that I an use my GPU.

from yolov8_ros.

What about the yolo topics? Check them (detections, tracking, detection_3d) to get where is getting stuck.

from yolov8_ros.

Seems like I get the tracking, detections but not hte detections_3d, and hence no dbg_image?

from yolov8_ros.

So, in this case, it may be getting stuck due to the target_frame. Check if you have this frame. If not, change it to your base frame, for instance, the camera_link, if you are using only a camera.

from yolov8_ros.

Hey @abs90, how is this going?

from yolov8_ros.