Train imnet using other data about im-net-pytorch HOT 8 CLOSED

1. Yes, but you need to change the line

self.data_points = (data_dict['points_'+str(self.sample_vox_size)][:].astype(np.float32)+0.5)/256-0.5

To

self.data_points = (data_dict['points_'+str(self.sample_vox_size)][:].astype(np.float32)+0.5)/self.sample_vox_size-0.5

I haven't tried it myself so let me know if there is a bug.

If you need 256^3 voxels, just use binvox to generate them. You only need to change the shape loader to load binvox files instead of mat files. You can do that using binvox_rw.py:

voxel_model_256 = binvox_rw.read_as_3d_array("example.binvox").data.astype(np.uint8)

Note that you need to make sure the top direction of the shape is pointing Y(j) positive direction. Otherwise, the z-carving in the code does not work.

2. You can use image files without alpha channels.

img = cv2.imread("example.png")
img = cv2.cvtColor(img, cv2.COLOR_BGR2GRAY)
hdf5_file["pixels"][idx,t,:,:] = img

from im-net-pytorch.

I'm very grateful for your replying.So:
1.If I want to use 256^3 voxel, can I just change command:
binvox -bb -0.5 -0.5 -0.5 0.5 0.5 0.5 -d 64 -e input.obj
to:
binvox -bb -0.5 -0.5 -0.5 0.5 0.5 0.5 -d 256 -e input.obj
2.Considering line 89 in 3_gather_img:
imgo = img[:,:,:3]
which raises error when running code because my png has no alpha channel.How to rewrite this line to get imgo to run line:
img = cv2.cvtColor(imgo, cv2.COLOR_BGR2GRAY)
in your replying?
By the way, Should I use 137x137 png to prepare my training data?
I'm sorry about bothering you again.
Thanks
Zh T

from im-net-pytorch.

1. Yes. Remember to normalize the shapes first. The shape should be zero-centered and the diagonal of the bounding box needs to be 1.

2. Make sure your image has 3 channels and just run cv2.cvtColor(img, cv2.COLOR_BGR2GRAY).

3. The provided code assumes images are 137x137. But during training the images are cropped to 128x128. If you do not want to change the code, use 137x137.

from im-net-pytorch.

Thank you very much,now I have no problem temporarily.

from im-net-pytorch.

It works in training (using 256^3binvox and RGB single view image),thank you very much !

from im-net-pytorch.

Hello, lun22u. I want to ask how to get rendering views images used in https://github.com/czq142857/IM-NET/blob/master/point_sampling/3_gather_img.py? Are they generated from https://github.com/czq142857/IM-NET/blob/master/point_sampling/2_test_hdf5.py?

from im-net-pytorch.

from im-net-pytorch.

Thank you for your reply, lun22u. I have successfully rendered my multi-view images. But there is a problem in normalizing the voxels. Could you tell me how to make the voxel centered and its diagonal of the bounding box to 1.

from im-net-pytorch.