Comments (6)
Hi @corkoh did you try to debug the error - where does the issue start?
from depthai-experiments.
Here is the full error message. I looks like it starts in the PointCloudVisualizer class where it passes the camera list. The geometry:pointcloud is also a zero value.
I had tried to fill in the NoneType (h variable) by calling get_box_top before It does this math, and took out the return for h in the get_dimensions that is called right before this error.
That gave me some other errors, and so I figured I would reach out before I get carried away changing things I dont fully understand.
Traceback (most recent call last):
File "../depthai-experiments-master/gen2-multiple-devices/box-measurement/main.py", line 20, in
PointCloudVisualizer(cameras)
File "../depthai-experiments-master/gen2-multiple-devices/box-measurement/point_cloud_visualizer.py", line 33, in init
self.update()
File "../depthai-experiments-master/gen2-multiple-devices/box-measurement/point_cloud_visualizer.py", line 46, in update
self.vizualise_box()
File "../depthai-experiments-master/gen2-multiple-devices/box-measurement/point_cloud_visualizer.py", line 58, in vizualise_box
if lwh > config.min_box_size:
TypeError: unsupported operand type(s) for *: 'float' and 'NoneType'
from depthai-experiments.
Update: I played with the RGBD-PointCloud-Fusion and noticed that with the calibration I had the point cloud never aligned. I have since done several calibrations and different camera angles until the pointcloud aligned almost perfectly.
I then tried the Box Measurement and It worked. The pointcloud was a lot smaller and it did not pick up the length or width of the box, only the height. The box was cut off in the smaller pointcloud, so that could be why I only got the height.
Are there specific heights, angles, etc to get better consistent results?
Also my end goal is checking the size of a mattress, would this be feasible?
from depthai-experiments.
Hi @corkoh , Could you share some photos of camera angles, or how cameras see the box? wrt mattress - I'd say so, shouldn't be any more complicated than a box:)
from depthai-experiments.
Here is similar to what I had 'working' earlier. (Top down view, I chose this because it also seemed the most accurate when doing the single device box estimation.) Its not working now, as I was trying to get a corner angle and a side angle to work with no success.
I can see in this with pointcloud fusion that it is not aligning the checkerboards on the correct Z axis. Camera1 checkerboard appears far below.
I can not consistently get the checkerboard to align on the pointcloud. I think this is my problem. Pressing the 'A' key does not align, it crashes every time. The one time It aligned almost correctly the one time the box estimation worked but did not capture all dimensions.
I have not had any success with any other camera angles yet.
Here is the output of the align button from the point cloud fusion:
Traceback (most recent call last):
File "../gen2-multiple-devices/rgbd-pointcloud-fusion/main.py", line 21, in
PointCloudVisualizer(cameras)
File "../gen2-multiple-devices/rgbd-pointcloud-fusion/point_cloud_visualizer.py", line 28, in init
self.update()
File "../gen2-multiple-devices/rgbd-pointcloud-fusion/point_cloud_visualizer.py", line 38, in update
self.point_cloud_window.poll_events()
File "../gen2-multiple-devices/rgbd-pointcloud-fusion/point_cloud_visualizer.py", line 13, in
self.point_cloud_window.register_key_callback(ord('A'), lambda vis: self.align_point_clouds())
File "../gen2-multiple-devices/rgbd-pointcloud-fusion/point_cloud_visualizer.py", line 60, in align_point_clouds
result_icp = o3d.pipelines.registration.registration_colored_icp(
AttributeError: module 'open3d' has no attribute 'pipelines'
from depthai-experiments.
Ok I got box estimate to work again, the point cloud still does not line up perfectly. But the code is running since its close. I cleaned up my work space and got a proper table instead of a mattress. Not sure that changing out the surface helped any, but was able to get this angle working. The dimensions are not accurate. I imagine this is because the pointclouds dont fuse perfectly.
Here is my current set up:
Both cameras can see the checkerboard clearly, and when calibrating, they both find the same corner and orientate the x,y,z axis properly. So everything looks good when calibrating.
I rotated the pointcloud to show the discrepancies more, some of that floating away from the main piece is the checkerboard.
from depthai-experiments.
Related Issues (20)
- OAK-D-SR Camera save color image and depth image by record.py HOT 3
- [gen2-yolo/device-decoding] Visualization doesn't show camera footage or detections HOT 2
- To add mesh generation for gen2-pointcloud and Multiple camera HOT 2
- How to visualize when I record data with gen2-record-replay?
- Why pylance is complaining about NNData(), node, and ImageManipConfig() call in script.py from gen2-gaze-estimation project?(Solved) HOT 2
- Head posture estimation module HOT 2
- segmentation with yolov5
- Head pose estimation HOT 2
- How to load external video or webcam feed and process it on device side HOT 1
- New recommendations on head pose estimation model. HOT 1
- Support for YOLOP HOT 2
- Depth information in deep learning model HOT 3
- Camera extrinsic parameter HOT 1
- Issue with installing requirements for RTSP streaming HOT 1
- Deploy yolov8 on OAK-D HOT 6
- Challenges Installing PyGObject for OKA Camera RTSP Streaming HOT 1
- Can we specify the layers you are interested in for a custom nn ? HOT 8
- Yolo v8 on OAK-D camera HOT 1
- gen2-pedestrian-reidentification freezes while person is detected HOT 3
- Yolov8 on OAK-1 using depthai_sdk HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from depthai-experiments.