matansel / pix2vertex Goto Github PK
View Code? Open in Web Editor NEWUnrestricted Facial Geometry Reconstruction Using Image-to-Image Translation
Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translation
The code could run successfully, but the output is random. The output of the deep network is good but when doing 'Affine Align', the alignment results between the depth and 3D template are random. The results are different when running the code several times. Sometimes only partial face is reconstructed. I think this may be the depth cannot align well with the template. The 'postprocess.p' is protected so I cannot figure out the problem.
I run the code and everything is working great but I don't know how save the mesh as stl or obj .. l don't know much about MATLAB. If you can help me i would be so grateful... Just want to 3d print the face of a person i lost
Hello,
I get the following error in some cases (not image specific, encounter it when I run on multiple images)
Starting Detail Extraction
Attempted to access imgh(-0,163); index must be a positive integer or logical.
Error in mesh2fine>ZBuffer (line 635)
Error in mesh2fine>mesoscopic_deformation (line 80)
Error in mesh2fine (line 25)
Error in runme (line 58)
[ fine_result ] = mesh2fine(pipeline_args); %% 7
The file template.mat is missing in the mentioned Google drive zip file. It is required in the function raw2depth.m.
Thanks for nice work.
By the way, how did you apply RANSAC to get global scaling and transition parameters?
Hello all,
I've been experimenting with your code in pytorch, and it is my understanding that there is a final step that is not applied using the python/torch method you've published. The results in this repo seem to be way more accurate than pytorch is able to provide.
In that light I have two questions:
Thank you,
Thanks for sharing this code, however, it's a little bit slow when I running it, can I running it with a GPU?
Hi! First of all, great paper, awesome results! Never had much interest in machine learning, but this paper actually inspired me to learn more and try it out. I've tried to run this implementation, following the instructions in Readme, but I've stumbled an issue when running the code in Matlab (on Ubuntu 16.04 and Matlab R2012a, latest version of Torch). At the postprocessing step I get error:
Error using **repmat**
Too many input arguments.
Error in /home/user/pix2vertex/postprocess.p>postprocess (line 38)
Error in **runme** (line 42)
[vertex, face, texture] = postprocess(img, im_pncc, im_depth, show_figs);
I don't have much experience with Matlab, but according to docs, .p file is a protected file, so I don't really have access and can't really debug what's going on down there. Would be great if you give some pointers!
My best, Ilja
I use GPU and change the run_net.lua file :
output = model:cuda():forward(in_im:cuda()):double()
but I still got errors:
Running Net...//torch/install/bin/luajit: //torch/install/share/lua/5.1/torch/Tensor.lua:238: attempt to index a nil value
stack traceback:
//torch/install/share/lua/5.1/torch/Tensor.lua:238: in function 'type'
./torch/install/share/lua/5.1/nngraph/gmodule.lua:233: in function 'recursiveType'
**/torch/install/share/lua/5.1/nngraph/gmodule.lua:247: in function 'applyTypeToTable'
**/torch/install/share/lua/5.1/nngraph/gmodule.lua:252: in function 'cuda'
run_net.lua:27: in main chunk
[C]: in function 'dofile'
/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
[C]: at 0x00405d50
Error using load
Unable to read file '//pix2vertex-master/imgs/2327-3-res.mat'. No such file or directory.
Error in run_net (line 13)
net_res = load(resname);
Error in runme (line 26)
im_pncc = run_net( img, '/**/pix2vertex-master/models/pncc_net.t7', im_file(1:end-4));
Do you know how to fix it?
How to export genreated mesh? Like to obj.
And how to leave the mesh unchopped so the vertex order kept?
Hello,
when compiling the code, I found out that the line system(['OMP_NUM_THREADS=1 th run_net.lua -model ' net_path ' -inputs ' matname ' -res ' resname ]); in "run_net.m" doesn't work for me.
When typing this: [f,k]=system(['OMP_NUM_THREADS=1 th run_net.lua -model ' net_path ' -inputs ' matname ' -res ' resname ]) I get these results:
k =
127
f =
'/mnt/appl/software/Torch/1.0-goolfc-2018a/bin/luajit: symbol lookup error: /home.others/eb/easybuild/software/Torch/1.0-goolfc-2018a/lib/libTH.so.0: undefined symbol: dgemm_
'
Does anyone know how to fix this?
Thanks in adavance.
Thanks for you sharing this code, it's quite incredible, however, I cannot open and edit the postprocess.p file, is these any way to open and edit this file.
Any help will be gratefully appreciated!
Hi Matan and Elad,
Thanks for an awesome work!
In your paper Fig.9, you show results of each one of your 3 steps results.
However, in the code, the non-rigid registration and fine-details reconstruction are packed into a single post-processing function. Is it possible that you provide them as two separate functions?
That would be really helpful in many scenarios; i.e if ground truth coarse shape is given, it's can be feed to your refinement module to do further processing.
Thanks
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.