forth-modelbasedtracker / handtracker Goto Github PK

Running the script results in and error

raceback (most recent call last):
File "", line 1, in
File "C:\Users\jocker\Anaconda2\lib\site-packages\spyderlib\widgets\externalshell\sitecustomize.py", line 699, in runfile
execfile(filename, namespace)
File "C:\Users\jocker\Anaconda2\lib\site-packages\spyderlib\widgets\externalshell\sitecustomize.py", line 74, in execfile
exec(compile(scripttext, filename, 'exec'), glob, loc)
File "F:/FORTH/src/SingleHandTracking.py", line 56, in
ht = HT.HandTrackerLib(2048, 2048, 64, 64, erenderer)
RuntimeError: E:\mbv\Decoding\GenericDecoder\GenericDecoder.cpp(1320): Throw in function void __cdecl MBV::Decoding::GenericDecoder::loadFromFile(class std::basic_string<char,struct std::char_traits,class std::allocator >,bool)
Dynamic exception type: struct MBV::Core::Exception
[struct MBV::Core::Message * __ptr64] = could not open file for reading
[struct MBV::Core::OffendingCode * __ptr64] = ifs.good()

runfile('E:/FORTH/HANDTRACKER/src/SingleHandTracking.py', wdir='E:/FORTH/HANDTRACKER/src')
Traceback (most recent call last):

File "C:\Users\xzt\Anaconda2\lib\site-packages\IPython\core\interactiveshell.py", line 2902, in run_code
self.showtraceback()

File "C:\Users\xzt\Anaconda2\lib\site-packages\IPython\core\interactiveshell.py", line 1830, in showtraceback
value, tb, tb_offset=tb_offset)

File "C:\Users\xzt\Anaconda2\lib\site-packages\IPython\core\ultratb.py", line 1394, in structured_traceback
self, etype, value, tb, tb_offset, number_of_lines_of_context)

File "C:\Users\xzt\Anaconda2\lib\site-packages\IPython\core\ultratb.py", line 1311, in structured_traceback
self, etype, value, elist, tb_offset, number_of_lines_of_context

File "C:\Users\xzt\Anaconda2\lib\site-packages\IPython\core\ultratb.py", line 642, in structured_traceback
lines = ''.join(self._format_exception_only(etype, value))

File "C:\Users\xzt\Anaconda2\lib\site-packages\IPython\core\ultratb.py", line 754, in _format_exception_only
Colors.Normal, s))

UnicodeDecodeError: 'ascii' codec can't decode byte 0xd5 in position 17: ordinal not in range(128)

I have run the demo of this lib. But this lib is not open source,which hinder the further development. And this demo is just to track the hand. Do you have further application of this lib, such as gesture recognization?

When running the tracker on Linux (Ubuntu 15.10), I get the following errer:

$ ./runme.sh 
MBV_LIBS Environment variable should point to the MBV libraries folder.
MBV_LIBS /home/slemaignan/applis/MBV_PythonAPI_Linux_1.1/
Setting LD_LIBRARY_PATH and PYTHONPATH
Running the Single Hand Tracker script...
Creating Renderer...
[2015-11-17 13:14:16.524800] [0x000007fa9541c170] [warning] Read options from environment : unrecognised option 'libs'
[2015-11-17 13:14:16.524891] [0x000007fa9541c170] [warning] Read options from environment : unrecognised option 'libs'
Traceback (most recent call last):
  File "src/SingleHandTracking.py", line 33, in <module>
    renderer = Rendering.RendererOGLCudaExposed.get()
RuntimeError: /home/padeler/work/mbv/release_libs/src/mbv/Rendering/RendererOGL/RendererOGL.cpp(1142): Throw in function MBV::Rendering::RendererOGLCudaExposed::RendererOGLCudaExposed(MBV::Core::UInt, MBV::Core::UInt, MBV::Core::UInt, const String&, const String&)
Dynamic exception type: boost::exception_detail::clone_impl<MBV::Core::Exception>
[MBV::Core::Message*] = unknown error

Any idea?

Hi,
I would like to use the Hand Tracker (for now just the SingleHandTracking.py) with some RealSense sequences that I have previously recorded and saved to image files. Ideally I would like to simply load opencv images, i.e. not go through an .oni file as suggested here #42 . Is this possible? Could you perhaps help me out with some tips on how to set the calibration data (variable clbs if I understand correctly) (formats etc) and the image data (variable imgs)?
Thanks very much.

The provided demo (SingleHandTracking.py) takes a reference ONI file as input. It would be nice to have an example that shows how to use a live RGBD stream as well (or at least some documentation for the API of Acquisition.OpenNIGrabber)

Hi,
I've read the Python script and I found the MBV pretty cool; now I want to try some self-collected data, and I found it necessary to know the details of PyMBVCore.CameraMeta. Would you mind tell me something about this?

Thank You! :-)

Good Afternoon,

I am working with a group at Rochester Institute of Technology, I have been working with the python code for the your hand tracking libraries located in HandTracker-master > src > SingleHandTracking.py . I have been tasked with retrieving the tracking data from the python code. I noticed that your variable Core.ParamVector() is used to keep track of the current hand position. My question is what are the dependencies Core.ParamVector() takes and how should I read the dependencies so that I may determine the exact distances.

Very Respectfully,

Dominic Paul Curcione
[email protected]
Rochester Institute of Technology

Hello, I can not run the tracker in live capture

I set the path to the empty string (oniPath = ''). But OpenNI error is occured.

My system is windows10, CUDA 7.5 and Kinect v2.

Could you tell me how to solve it ?

I am running the Handtracker on Ubuntu 15.10 with gcc 5.2. The issue is that opencv on the system has to be compiled with gcc <5.0 in order to be working with the hand tracker libs. Problem is the new ABI introduced with gcc 5.0

This is fine BUT if ROS comes into play things get worst. ROS has to be compiled with gcc< 5.0 as well in order to be compatible with the hand tracker. This fails because the system BOOST is not compatible with gcc < 5.0 and so on, resulting in building Boost as well with gcc< 5.0 and so on. Would it be possible to have two versions of the hand tracker binaries compiled? One with gcc<5.0 and one with gcc>5.0? This would solve many issues with Ubuntu > 14.04 (which is almost two years old now).

Thanx

Hi please could you help me with the following error:

ERROR MESSAGE:
C:\Users\CIT-guest\Documents\GitHub\HandTracker>runme.bat
MBV_LIBS Environment variable should point to the MBV libraries folder.
MBV_LIBS C:\Users\CIT-guest\Documents\GitHub\MBV_PythonAPI_Win_1.1
Setting PATH and PYTHONPATH
"Running the Single Hand Tracker script..."
Creating Renderer...
[2015-11-26 18:11:50.513381] [0x000001cf] [warning] Read options from environment : unrecognised option 'libs'
[2015-11-26 18:11:50.513381] [0x000001cf] [warning] Read options from environment : unrecognised option 'libs'
Traceback (most recent call last):
File "src\SingleHandTracking.py", line 33, in
renderer = Rendering.RendererOGLCudaExposed.get()
RuntimeError: E:\mbv\Rendering\RendererOGL\OpenGLHelpers.cpp(158): Throw in function void __cdecl OGL::ThrowOnCompileLinkError(unsigned int,enum OGL::CompLinkMode,const class std::basic_string<char,struct std::char_traits,class std::allocator > &)
Dynamic exception type: class boost::exception_detail::clone_impl
[struct MBV::Core::Message * __ptr64] = error while compiling file :
ERROR: 0:2: 'flat' : syntax error syntax error

MY SETUP

HARDWARE

• Intel Core i7
• 8 GB of RAM
• GPU: Nvidia GeForce GT 555M
• CUDA: 7.5.18
• OpenGL 4.5
• OpenCL 1.1

SOFTWARE
OS

• 64bit Windows 10

Environment

• Python 2.7 64bit (Anaconda and numpy)

Drivers

• OpenNI driver (OpenNI 1.x SDK for Windows 8 64bit and OpenNI 1.x sensor driver for 8 Windows 64bit)
• Kinect 2 driver (Kinect 2 SDK for Windows 8 64bit and newer)

I changed the onipath to empty string to perform live capture from an existing sensor
oniPath = ''
when i run .runme.sh i fails to find the sensor. The sensor however is working properly, I checked in a different setup.

I get message:
Starting Grabber...
[2016-02-16 20:11:45.754993] [0x000007f17dbaad74] [error] XN node not present. One or more of the following nodes could not be enumerated:

[2016-02-16 20:11:45.755059] [0x000007f17dbaad74] [error] Failed to initialize openni_acquisition plugin. /home/padeler/work/mbv/release_libs/src/mbv/Acquisition/OpenNIGrabber/OpenNIGrabber.cpp(166): Throw in function void MBV::Acquisition::OpenNIGrabber::xnCheckReturnCode(int)
Dynamic exception type: boost::exception_detail::clone_implMBV::Core::Exception
[MBV::Core::Message*] = OpenNI error. Node not present

Entering main Loop.
[2016-02-16 20:11:45.755114] [0x000007f17dbaad74] [error] Xn function Failed: Input pointer is null!

Is carmine 1.09 supported. What other sensors can I use?

thanks for your answer in advance

It would be nice if the external dependencies in Linux (mainly OpenCV, if possible also OpenNI1) were supported in the case where they were compiled and installed manually by the user (ideally in a location corresponding to an enviroment variable), rather than with the binary Ubuntu packages.

For example, I normally use a recent version of OpenCV (newer than 2.4.8 which is the current libopencv-dev), compiled with some custom flags, to run other vision projects. I would like to use your hand tracker with that version if possible, rather than having to install another OpenCV system-wide, which can override the dependencies and builds in my "other" projects. Not super critical or annoying, but it would be a nice addition for the future. Cheers.

Hello nkyriazis:
I found the api is working on an existed video. Could this api work on the input of the kinnect2? How could I achieve that?

I made the tracker run with a Kinect sensor. I can see the image with a hand in the middle. The problem is that the hand is not tracking. When I move the hand into the vicinity, the hand model does not move. Any ideas? Maybe some params to adjust?

Cheers,

Markus

@Sahbaap asks in #8 : "Is there any way that we can skip the initialization part of the code?"

Hi,

great work! I am trying to use SingleHandTracking.py to test it directly with data coming live from a Kinect 2. The demo runs fine with the supplied loop.oni file. According to the comments I changed the path to be empty:

oniPath = ''
    acq = Acquisition.OpenNIGrabber(True, True, 'media/openni.xml', oniPath, True)

The application starts but crashes shortly thereafter with the following error:
...
Randomization Indices: [7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26]
Starting Grabber...
[2016-04-18 15:36:35.542558] [0x00000182] [error] XN node not present. One or more of the following nodes could not be enumerated:

[2016-04-18 15:36:35.630817] [0x00000182] [error] Failed to initialize openni_acquisition plugin. E:\mbv\Acquisition\OpenNIGrabber\OpenNIGrabber.cpp(166): Throw in function void __cdecl MBV::Acquisition::OpenNIGrabber::xnCheckReturnCode(int)
Dynamic exception type: class boost::exception_detail::clone_impl
[struct MBV::Core::Message * __ptr64] = OpenNI error. Node not present

Entering main Loop.
[2016-04-18 15:36:35.658765] [0x00000182] [error] Xn function Failed: Input pointer is null!

Do I need to change anything in the openni.xml ? I have installed the SensorKinect093-Bin-Win64-v5.1.2.1.msi driver .

Kind regards.
Iason

Hi,

I get this error when I run the ./runme.sh

omari@Lucas:~/FORTH/HandTracker$ ./runme.sh 
MBV_LIBS Environment variable should point to the MBV libraries folder.
MBV_LIBS /home/omari/FORTH/HandTracker/
Setting LD_LIBRARY_PATH and PYTHONPATH
Running the Single Hand Tracker script...
Creating Renderer...
[2016-09-22 12:05:15.792818] [0x000007f11ffab874] [warning] Read options from environment : unrecognised option 'libs'
[2016-09-22 12:05:15.793245] [0x000007f11ffab874] [warning] Read options from environment : unrecognised option 'libs'
Traceback (most recent call last):
  File "src/SingleHandTracking.py", line 33, in <module>
    renderer = Rendering.RendererOGLCudaExposed.get()
RuntimeError: /home/padeler/work/mbv/release_libs/src/mbv/Rendering/RendererOGL/OpenGLHelpers.cpp(158): Throw in function void OGL::ThrowOnCompileLinkError(GLuint, OGL::CompLinkMode, const String&)
Dynamic exception type: boost::exception_detail::clone_impl<MBV::Core::Exception>
[MBV::Core::Message*] = error while compiling file :
0:1(10): error: GLSL 3.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.00 ES, and 3.00 ES

Hello,

I received the following import error. Note, I am currently running libfreenect (versus libfreenect 2) so that may be a problem. However, it is unclear if that is causing python to throw the error.

MBV_LIBS Environment variable should point to the MBV libraries folder.
MBV_LIBS /home/rabadi/software/mbv
Setting LD_LIBRARY_PATH and PYTHONPATH
Running the Single Hand Tracker script...
Traceback (most recent call last):
File "src/SingleHandTracking.py", line 8, in
import PyMBVCore as Core
ImportError: /path/to/mbv/libs/libCore.so: undefined symbol: _ZN2cv9ExceptionC1EiRKSsS2_S2_i

Thanks!

I followed the given installation steps, but still got the following error when I ran runme.bat. Where / How can I fix this error?

"Running the Single Hand Tracker script..."
Creating Renderer...
[2016-02-24 15:07:42.696000] [0x00000450] [warning] Read options from environment : unrecognised option 'libs'
[2016-02-24 15:07:42.696990] [0x00000450] [warning] Read options from environment : unrecognised option 'libs'
Traceback (most recent call last):
File "SingleHandTracking.py", line 32, in
renderer = Rendering.RendererOGLCudaExposed.get()
RuntimeError: E:\mbv\Rendering\RendererOGL\OpenGLHelpers.cpp(158): Throw in function void __cdecl OGL::ThrowOnCompileLinkError(unsigned int,enum OGL::CompLinkMode,const class std::basic_string<char,struct std::char_traits,class std::allocator > &)
Dynamic exception type: class boost::exception_detail::clone_impl
[struct MBV::Core::Message * __ptr64] = error while compiling file :
ERROR: 0:2: 'output' : reserved word
ERROR: 0:2: 'output' : syntax error syntax error

I was poking around in the DLLs and it seems like there's a bunch of C++ code under the hood. Is there any chance that you'll provide a C++ library for HandTracker? We have a significant codebase for a project written in Visual C++, and this would simplify matters quite a bit for us!

I'm using the Kinect VERSION 1 on Windows 7. I followed all the steps. In the end when I execute the batch file, I get the error that's attached. Any assistance is welcomed.

Thankyou

Hi FORTH :)

I am now trying to feed the coordinates of the model hand calculated during hand tracking into MATLAB (Windows 10). I am using Matlab to execute operating system command using the function <system()>.

The error I get seems to be related to the hand tracking libraries. Kindly could you help me out? Thanks!

Error message in MATLAB

Setting PATH and PYTHONPATH 
"Running the Single Hand Tracker script..." 
Creating Renderer... 
Traceback (most recent call last): 
  File "C:\Users\store\Code\07_CBAS\HandTracker\src\SingleHandTracking.py", line 60, in <module> 
    ht = HT.HandTrackerLib(2048, 2048, 64, 64, erenderer) 
RuntimeError: E:\mbv\Decoding\GenericDecoder\GenericDecoder.cpp(1320): Throw in function void __cdecl MBV::Decoding::GenericDecoder::loadFromFile(class std::basic_string<char,struct std::char_traits<char>,class std::allocator<char> >,bool) 
Dynamic exception type: struct MBV::Core::Exception 
[struct MBV::Core::Message * __ptr64] = could not open file for reading 
[struct MBV::Core::OffendingCode * __ptr64] = ifs.good()

The README mentions that the MVB librairies are open-source, but the source is not available in this repository. It would be nice to add a link to the source, so that we can compile ourselves the project (which may solve issue #2).

Hi FORTH,

I am successfully able to run the SingleHandTracking.py file to test the cool hand tracking. I am now trying to feed the coordinates of the model hand calculated during hand tracking into MATLAB (Windows 10). I am using Matlab to execute operating system command using the function <system()>.

The error I get seems to be related to the hand tracking libraries. Kindly could you help me out? Thanks!

Error message in MATLAB

Setting PATH and PYTHONPATH 
"Running the Single Hand Tracker script..." 
Creating Renderer... 
Traceback (most recent call last): 
  File "C:\Users\store\Code\07_CBAS\HandTracker\src\SingleHandTracking.py", line 60, in <module> 
    ht = HT.HandTrackerLib(2048, 2048, 64, 64, erenderer) 
RuntimeError: E:\mbv\Decoding\GenericDecoder\GenericDecoder.cpp(1320): Throw in function void __cdecl MBV::Decoding::GenericDecoder::loadFromFile(class std::basic_string<char,struct std::char_traits<char>,class std::allocator<char> >,bool) 
Dynamic exception type: struct MBV::Core::Exception 
[struct MBV::Core::Message * __ptr64] = could not open file for reading 
[struct MBV::Core::OffendingCode * __ptr64] = ifs.good()

Hello, my system is Ubuntu 14.04 LTS, NVIDIA driver 352.63, CUDA 7.5.

When I run the tracker with the provided oni recording, it works.

Now I'd like to try the live capture from a sensor (Asus Xtion Pro Live). I set the path to the empty string (oniPath = '') but I obtain the following error.

$ ./runme.sh 
MBV_LIBS Environment variable should point to the MBV libraries folder.
MBV_LIBS /usr/local/src/robot/MBV_PythonAPI_Linux_1.1
Setting LD_LIBRARY_PATH and PYTHONPATH
Running the Single Hand Tracker script...
Creating Renderer...
[2015-11-17 18:05:42.675324] [0x000007f3792a8d74] [warning] Read options from environment : unrecognised option 'libs'
[2015-11-17 18:05:42.675436] [0x000007f3792a8d74] [warning] Read options from environment : unrecognised option 'libs'
  Warning! Material file '/usr/local/src/robot/HandTracker/media/sphere.mtl' not found!
Warning! Material '' not defined in material file.
  Warning! Material file '/usr/local/src/robot/HandTracker/media/cylinder.mtl' not found!
Warning! Material '' not defined in material file.
Variances:  [10.0, 10.0, 10.0, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1]
Low Bounds:  [-2000.0, -2000.0, -2000.0, -1.0, -1.0, -1.0, -1.0, 0.0, 1.2999999523162842, 0.0, 0.0, 0.0, 2.5, 0.0, 0.0, 0.0, 1.2999999523162842, 0.0, 0.0, 0.0, 1.2999999523162842, 0.0, 0.0, 0.0, 1.2999999523162842, 0.0, 0.0]
High Bounds:  [2000.0, 2000.0, 2000.0, 1.0, 1.0, 1.0, 1.0, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874, 1.0, 3.140000104904175, 1.5700000524520874, 1.5700000524520874, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874]
Randomization Indices:  [7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26]
Starting Grabber...
[2015-11-17 18:05:43.180230] [0x000007f3792a8d74] [error]   XN node not present. One or more of the following nodes could not be enumerated:


[2015-11-17 18:05:43.180337] [0x000007f3792a8d74] [error]   Failed to initialize openni_acquisition plugin. /home/padeler/work/mbv/release_libs/src/mbv/Acquisition/OpenNIGrabber/OpenNIGrabber.cpp(166): Throw in function void MBV::Acquisition::OpenNIGrabber::xnCheckReturnCode(int)
Dynamic exception type: boost::exception_detail::clone_impl<MBV::Core::Exception>
[MBV::Core::Message*] = OpenNI error. Node not present

Entering main Loop.
[2015-11-17 18:05:43.180441] [0x000007f3792a8d74] [error]   Xn function Failed: Input pointer is null!

First, it looks like some material files are not found in the media directory. In fact I don't see any .mtl there, only .obj and .xml.

Then, the OpenNIGrabber that is being called is from a /home/padeler/... path instead of my local path.

Any suggestion? Many thanks.

Hi I am installing in Ubuntu Linux 16.04. and I get errors as shown below

zayyon@zayyon-MS-7693:~/zayyon/HandTracker-master$ ./runme.shMBV_LIBS Environment variable should point to the MBV libraries folder.
MBV_LIBS /home/zayyon/zayyon/MBV_PythonAPI_Linux_1.1/
Setting LD_LIBRARY_PATH and PYTHONPATH
Running the Single Hand Tracker script...
Traceback (most recent call last):
File "src/SingleHandTracking.py", line 8, in
import PyMBVCore as Core
ImportError: /home/zayyon/zayyon/MBV_PythonAPI_Linux_1.1//libs/libCore.so: undefined symbol: _ZN2cv9ExceptionC1EiRKSsS2_S2_i

my setup: ubuntu 14.04, nvidia-gtx960, carmine 1.09. I also tried with kinect v1. when i run Single handtracker, it gives error for both(kinect and carmine 1.09):

$ python SingleHandTracking.py
Creating Renderer...
[2016-08-03 11:50:56.489215] [0x000007ffaee5d374] [warning] Read options from environment : unrecognised option 'libs'
[2016-08-03 11:50:56.489337] [0x000007ffaee5d374] [warning] Read options from environment : unrecognised option 'libs'
Traceback (most recent call last):
File "SingleHandTracking.py", line 56, in
ht = HT.HandTrackerLib(2048, 2048, 64, 64, erenderer)
RuntimeError: /home/padeler/work/mbv/release_libs/src/mbv/Decoding/GenericDecoder/GenericDecoder.cpp(1320): Throw in function void MBV::Decoding::GenericDecoder::loadFromFile(std::string, bool)
Dynamic exception type: MBV::Core::Exception
[MBV::Core::OffendingCode_] = ifs.good()
[MBV::Core::Message_] = could not open file for reading

I am using the Kinect V2 on windows 10 and installed all the necessary prime sense and openni drivers but for some reason everytime I try to open up niviewer it says the device cannot be found. I am almost positive it is a driver issue but I am not exactly sure how to get prime sense completely working on windows 10 with the kinect 2. Any help would be much appreciated

After starting the runme.sh script it takes EVERY time around 3! minutes until the window appears.
Even after setting the CUDA_CACHE_MAXSIZE=2147483648, as recommended.

Is there any way to speed up the process?

System used: Ubuntu 15.10, CUDA 7.5, NVIDIA GTX860M (4GB RAM), 16GB RAM, Intel I7 CPU

<name>palm_pos</name>
<hook_name>ground</hook_name>
<link_type>TranslationQuaternion</link_type>
<trans_X>-200</trans_X>
<trans_X>-2000</trans_X>
<trans_X>2000</trans_X>
<trans_X>1</trans_X>
<trans_X>0</trans_X>
<trans_Y>0</trans_Y>
<trans_Y>-2000</trans_Y>
<trans_Y>2000</trans_Y>
<trans_Y>1</trans_Y>
<trans_Y>0</trans_Y>
<trans_Z>-900</trans_Z>
<trans_Z>-2000</trans_Z>
<trans_Z>2000</trans_Z>
<trans_Z>1</trans_Z>
<trans_Z>0</trans_Z>
<qX>0</qX>
<qX>-1</qX>
<qX>1</qX>
<qX>1</qX>
<qX>0</qX>
<qY>0</qY>
<qY>-1</qY>
<qY>1</qY>
<qY>1</qY>
<qY>0</qY>
<qZ>1</qZ>
<qZ>-1</qZ>
<qZ>1</qZ>
<qZ>1</qZ>
<qZ>0</qZ>
<qW>0</qW>
<qW>-1</qW>
<qW>1</qW>
<qW>1</qW>
<qW>0</qW>

As show above, take the trans_X for example,the number of trans_X is 5.Maybe the first is default, the second is min and the third is max. But what's the rest two?Can I get a simple answer or just a hint?

I was able to run the offline detection, by setting oniPath to a previous registration.

Trying to have a live capture with a Aus Xtion live pro, I obtain this error:

$ ./runtest.sh
[2016-01-14 15:36:37.041002] [0x000007f819cf4474] [error]   Xn function Failed: A timeout has occurred when waiting for new data!

Trying to get more information I edited the runme.sh, opening a interactive python shell. I changed the last line into:
python -i src/SingleHandTracking.py

Not always, but more than 90%, of times this is what I got when grabbing from the device:

>>> acq.grab()
[2016-01-14 15:37:20.962590] [0x000007f00be23674] [error]   Xn function Failed: A timeout has occurred when waiting for new data!
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
RuntimeError: /home/padeler/work/mbv/release_libs/src/mbv/Acquisition/OpenNIGrabber/OpenNIGrabber.cpp(171): Throw in function void MBV::Acquisition::OpenNIGrabber::xnCheckReturnCode(int)
Dynamic exception type: boost::exception_detail::clone_impl<MBV::Core::Exception>
[MBV::Core::Message*] = OpenNI error. Function Failed

The Xtion is working and with NiViewer I can have a proper live video. I used this to record new oni file to try your tracker.
The problem occurs only when grabbing the image with grab method. Do you have any hints?

Hi,

I followed the instructions you provided n could run runme.bat from the command line which shows a person whose right hand is being tracked. I am just wondering if there is a sample code of your software that works with Kinect v2 in which I can test it.

Thanks!

Hi,
I want to use your code SingleHandTracking.py as a baseline to compare with other codes, but I'm wondering if it's possible to use your code with a recorded dataset.
Thanks

setup :ubuntu14.04,64 bit, cuda-7.5, nvidiagtx960, carmine 1.09

when i run runme.sh i see

the message on the terminal is:

$./runme.sh
MBV_LIBS Environment variable should point to the MBV libraries folder.
MBV_LIBS /home/himalaya/shome/forth_hand_tracking/MBV_PythonAPI_Linux_1.1
Setting LD_LIBRARY_PATH and PYTHONPATH
Running the Single Hand Tracker script...
Creating Renderer...
[2016-02-13 19:58:10.302617] [0x000007f366a72974] [warning] Read options from environment : unrecognised option 'libs'
[2016-02-13 19:58:10.302728] [0x000007f366a72974] [warning] Read options from environment : unrecognised option 'libs'
* Warning! Material file '/home/himalaya/shome/forth_hand_tracking/HandTracker-master/media/sphere.mtl' not found!
Warning! Material '' not defined in material file.
Warning! Material file '/home/himalaya/shome/forth_hand_tracking/HandTracker-master/media/cylinder.mtl' not found!*
Warning! Material '' not defined in material file.
Variances: [10.0, 10.0, 10.0, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1]
Low Bounds: [-2000.0, -2000.0, -2000.0, -1.0, -1.0, -1.0, -1.0, 0.0, 1.2999999523162842, 0.0, 0.0, 0.0, 2.5, 0.0, 0.0, 0.0, 1.2999999523162842, 0.0, 0.0, 0.0, 1.2999999523162842, 0.0, 0.0, 0.0, 1.2999999523162842, 0.0, 0.0]
High Bounds: [2000.0, 2000.0, 2000.0, 1.0, 1.0, 1.0, 1.0, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874, 1.0, 3.140000104904175, 1.5700000524520874, 1.5700000524520874, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874]
Randomization Indices: [7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26]
Starting Grabber...
Entering main Loop.
init done
opengl support available

why is it not showing my sensor output?

Hello :),

I was wondering if I can download and install the tracker on a mac laptop and if there are specific installation steps to follow.

Thank you for your kind attention.

I wanna write down articulation information to file in 3D or 2D dimensional image, but I didn't know how do it.
How should I write down it to file?

The analyzing result of Dependency walker shows these following DLL cannot be opened, and these Dlls are similar.So how can I fix it? Apologize for my poor English. I'm chinese.
API-MS-WIN-CORE-APIQUERY-L1-1-0.DLL
API-MS-WIN-CORE-APPCOMPAT-L1-1-1.DLL
API-MS-WIN-CORE-APPINIT-L1-1-0.DLL
API-MS-WIN-CORE-ATOMS-L1-1-0.DLL
API-MS-WIN-CORE-COMM-L1-1-0.DLL
API-MS-WIN-CORE-CONSOLE-L1-1-0.DLL
API-MS-WIN-CORE-CONSOLE-L2-1-0.DLL
API-MS-WIN-CORE-CRT-L1-1-0.DLL
API-MS-WIN-CORE-DATETIME-L1-1-1.DLL
API-MS-WIN-CORE-DATETIME-L1-1-2.DLL
API-MS-WIN-CORE-DEBUG-L1-1-1.DLL
API-MS-WIN-CORE-DELAYLOAD-L1-1-1.DLL
API-MS-WIN-CORE-ENCLAVE-L1-1-0.DLL
API-MS-WIN-CORE-ERRORHANDLING-L1-1-1.DLL
API-MS-WIN-CORE-ERRORHANDLING-L1-1-3.DLL
API-MS-WIN-CORE-FIBERS-L1-1-1.DLL
API-MS-WIN-CORE-FILE-L1-2-1.DLL
API-MS-WIN-CORE-FILE-L1-2-2.DLL
API-MS-WIN-CORE-FILE-L2-1-1.DLL
API-MS-WIN-CORE-FILE-L2-1-2.DLL
API-MS-WIN-CORE-HANDLE-L1-1-0.DLL
API-MS-WIN-CORE-HEAP-L1-2-0.DLL
API-MS-WIN-CORE-HEAP-L2-1-0.DLL
API-MS-WIN-CORE-HEAP-OBSOLETE-L1-1-0.DLL
API-MS-WIN-CORE-INTERLOCKED-L1-2-0.DLL
API-MS-WIN-CORE-IO-L1-1-1.DLL
API-MS-WIN-CORE-JOB-L1-1-0.DLL
API-MS-WIN-CORE-JOB-L2-1-0.DLL
API-MS-WIN-CORE-KERNEL32-LEGACY-L1-1-1.DLL
API-MS-WIN-CORE-KERNEL32-LEGACY-L1-1-4.DLL
API-MS-WIN-CORE-KERNEL32-PRIVATE-L1-1-1.DLL
API-MS-WIN-CORE-KERNEL32-PRIVATE-L1-1-2.DLL
API-MS-WIN-CORE-LARGEINTEGER-L1-1-0.DLL
API-MS-WIN-CORE-LIBRARYLOADER-L1-2-0.DLL
API-MS-WIN-CORE-LIBRARYLOADER-L1-2-1.DLL
API-MS-WIN-CORE-LIBRARYLOADER-L2-1-0.DLL
API-MS-WIN-CORE-LOCALIZATION-L1-2-1.DLL
API-MS-WIN-CORE-LOCALIZATION-L1-2-2.DLL
API-MS-WIN-CORE-LOCALIZATION-L2-1-0.DLL
API-MS-WIN-CORE-LOCALIZATION-OBSOLETE-L1-3-0.DLL
API-MS-WIN-CORE-LOCALIZATION-PRIVATE-L1-1-0.DLL
API-MS-WIN-CORE-MEMORY-L1-1-2.DLL
API-MS-WIN-CORE-MISC-L1-1-0.DLL
API-MS-WIN-CORE-NAMEDPIPE-L1-2-0.DLL
API-MS-WIN-CORE-NAMEDPIPE-L1-2-2.DLL
API-MS-WIN-CORE-NAMESPACE-L1-1-0.DLL
API-MS-WIN-CORE-NORMALIZATION-L1-1-0.DLL
API-MS-WIN-CORE-PATH-L1-1-0.DLL
API-MS-WIN-CORE-PERFCOUNTERS-L1-1-0.DLL
API-MS-WIN-CORE-PRIVATEPROFILE-L1-1-1.DLL
API-MS-WIN-CORE-PROCESSENVIRONMENT-L1-2-0.DLL
API-MS-WIN-CORE-PROCESSSNAPSHOT-L1-1-0.DLL
API-MS-WIN-CORE-PROCESSTHREADS-L1-1-2.DLL
API-MS-WIN-CORE-PROCESSTHREADS-L1-1-3.DLL
API-MS-WIN-CORE-PROCESSTOPOLOGY-L1-2-0.DLL
API-MS-WIN-CORE-PROFILE-L1-1-0.DLL
API-MS-WIN-CORE-PSAPI-ANSI-L1-1-0.DLL
API-MS-WIN-CORE-PSAPI-L1-1-0.DLL
API-MS-WIN-CORE-QUIRKS-L1-1-0.DLL
API-MS-WIN-CORE-REALTIME-L1-1-0.DLL
API-MS-WIN-CORE-REGISTRY-L1-1-0.DLL
API-MS-WIN-CORE-REGISTRY-L1-1-1.DLL
API-MS-WIN-CORE-REGISTRYUSERSPECIFIC-L1-1-0.DLL
API-MS-WIN-CORE-RTLSUPPORT-L1-2-0.DLL
API-MS-WIN-CORE-SHLWAPI-LEGACY-L1-1-0.DLL
API-MS-WIN-CORE-SHLWAPI-OBSOLETE-L1-2-0.DLL
API-MS-WIN-CORE-SIDEBYSIDE-L1-1-0.DLL
API-MS-WIN-CORE-STRING-L1-1-0.DLL
API-MS-WIN-CORE-STRING-L2-1-0.DLL
API-MS-WIN-CORE-STRING-L2-1-1.DLL
API-MS-WIN-CORE-STRING-OBSOLETE-L1-1-0.DLL
API-MS-WIN-CORE-STRINGANSI-L1-1-0.DLL
API-MS-WIN-CORE-SYNCH-L1-1-0.DLL
API-MS-WIN-CORE-SYNCH-L1-2-0.DLL
API-MS-WIN-CORE-SYNCH-L1-2-1.DLL
API-MS-WIN-CORE-SYSINFO-L1-2-1.DLL
API-MS-WIN-CORE-SYSINFO-L1-2-3.DLL
API-MS-WIN-CORE-SYSTEMTOPOLOGY-L1-1-0.DLL
API-MS-WIN-CORE-THREADPOOL-L1-2-0.DLL
API-MS-WIN-CORE-THREADPOOL-LEGACY-L1-1-0.DLL
API-MS-WIN-CORE-THREADPOOL-PRIVATE-L1-1-0.DLL
API-MS-WIN-CORE-TIMEZONE-L1-1-0.DLL
API-MS-WIN-CORE-URL-L1-1-0.DLL
API-MS-WIN-CORE-UTIL-L1-1-0.DLL
API-MS-WIN-CORE-VERSION-L1-1-0.DLL
API-MS-WIN-CORE-VERSIONANSI-L1-1-0.DLL
API-MS-WIN-CORE-WINDOWSERRORREPORTING-L1-1-0.DLL
API-MS-WIN-CORE-WINRT-ERROR-L1-1-1.DLL
API-MS-WIN-CORE-WOW64-L1-1-0.DLL
API-MS-WIN-CORE-WOW64-L1-1-1.DLL
API-MS-WIN-CORE-XSTATE-L2-1-0.DLL
API-MS-WIN-EVENTING-CLASSICPROVIDER-L1-1-0.DLL
API-MS-WIN-EVENTING-CONSUMER-L1-1-0.DLL
API-MS-WIN-EVENTING-CONTROLLER-L1-1-0.DLL
API-MS-WIN-EVENTING-PROVIDER-L1-1-0.DLL
API-MS-WIN-SECURITY-APPCONTAINER-L1-1-0.DLL
API-MS-WIN-SECURITY-AUDIT-L1-1-1.DLL
API-MS-WIN-SECURITY-BASE-L1-2-0.DLL
API-MS-WIN-SECURITY-BASE-PRIVATE-L1-1-1.DLL
API-MS-WIN-SERVICE-CORE-L1-1-1.DLL
API-MS-WIN-SERVICE-CORE-L1-1-2.DLL
API-MS-WIN-SERVICE-MANAGEMENT-L1-1-0.DLL
API-MS-WIN-SERVICE-MANAGEMENT-L2-1-0.DLL
API-MS-WIN-SERVICE-PRIVATE-L1-1-0
API-MS-WIN-SERVICE-PRIVATE-L1-1-1.DLL
API-MS-WIN-SERVICE-PRIVATE-L1-1-2.DLL
API-MS-WIN-SERVICE-WINSVC-L1-2-0.DLL
API-MS-WIN-SHELL-SHELLCOM-L1-1-0.DLL
API-MS-WIN-SHELL-SHELLFOLDERS-L1-1-0.DLL
API-MS-WIN-STORAGE-EXPORTS-EXTERNAL-L1-1-0.DLL
API-MS-WIN-STORAGE-EXPORTS-INTERNAL-L1-1-0.DLL
BOOST_FILESYSTEM-VC120-MT-1_57.DLL
BOOST_PYTHON-VC120-MT-1_57.DLL
BOOST_SERIALIZATION-VC120-MT-1_57.DLL
BOOST_SYSTEM-VC120-MT-1_57.DLL
BOOST_WSERIALIZATION-VC120-MT-1_57.DLL
CORE.DLL
TBB.DLL
API-MS-WIN-APPMODEL-IDENTITY-L1-2-0.DLL
API-MS-WIN-APPMODEL-RUNTIME-INTERNAL-L1-1-0.DLL
API-MS-WIN-APPMODEL-RUNTIME-L1-1-0.DLL
API-MS-WIN-APPMODEL-RUNTIME-L1-1-1.DLL
API-MS-WIN-APPMODEL-STATE-L1-2-0.DLL
API-MS-WIN-APPMODEL-UNLOCK-L1-1-0.DLL
API-MS-WIN-BASE-UTIL-L1-1-0.DLL
API-MS-WIN-CORE-CALENDAR-L1-1-0.DLL
API-MS-WIN-CORE-COM-L1-1-0
API-MS-WIN-CORE-COM-L1-1-1.DLL
API-MS-WIN-CORE-COM-L2-1-1.DLL
API-MS-WIN-CORE-COM-MIDLPROXYSTUB-L1-1-0.DLL
API-MS-WIN-CORE-COM-PRIVATE-L1-1-0.DLL
API-MS-WIN-CORE-COM-PRIVATE-L1-1-1.DLL
API-MS-WIN-CORE-CRT-L2-1-0.DLL
API-MS-WIN-CORE-DEBUG-L1-1-0.DLL
API-MS-WIN-CORE-DELAYLOAD-L1-1-0.DLL
API-MS-WIN-CORE-ERRORHANDLING-L1-1-0.DLL
API-MS-WIN-CORE-FIBERS-L1-1-0.DLL
API-MS-WIN-CORE-FILE-L1-1-0.DLL
API-MS-WIN-CORE-FILE-L1-2-0.DLL
API-MS-WIN-CORE-FILE-L2-1-0.DLL
API-MS-WIN-CORE-HEAP-L1-1-0.DLL
API-MS-WIN-CORE-INTERLOCKED-L1-1-0.DLL
API-MS-WIN-CORE-IO-L1-1-0.DLL
API-MS-WIN-CORE-KERNEL32-LEGACY-L1-1-0.DLL
API-MS-WIN-CORE-LIBRARYLOADER-L1-1-0.DLL
API-MS-WIN-CORE-LOCALIZATION-L1-1-0.DLL
API-MS-WIN-CORE-LOCALIZATION-L1-2-0.DLL
API-MS-WIN-CORE-LOCALIZATION-OBSOLETE-L1-2-0.DLL
API-MS-WIN-CORE-LOCALREGISTRY-L1-1-0.DLL
API-MS-WIN-CORE-MARSHAL-L1-1-0.DLL
API-MS-WIN-CORE-MEMORY-L1-1-0.DLL
API-MS-WIN-CORE-PROCESSENVIRONMENT-L1-1-0.DLL
API-MS-WIN-CORE-PROCESSTHREADS-L1-1-0.DLL
API-MS-WIN-CORE-PROCESSTHREADS-L1-1-1.DLL
API-MS-WIN-CORE-PROCESSTOPOLOGY-OBSOLETE-L1-1-0.DLL
API-MS-WIN-CORE-PSM-KEY-L1-1-0.DLL
API-MS-WIN-CORE-REALTIME-L1-1-1.DLL
API-MS-WIN-CORE-REGISTRY-L2-2-0.DLL
API-MS-WIN-CORE-REGISTRY-PRIVATE-L1-1-0.DLL
API-MS-WIN-CORE-RTLSUPPORT-L1-1-0.DLL
API-MS-WIN-CORE-SHUTDOWN-L1-1-1.DLL
API-MS-WIN-CORE-SYSINFO-L1-1-0.DLL
API-MS-WIN-CORE-SYSINFO-L1-2-0.DLL
API-MS-WIN-CORE-TOOLHELP-L1-1-0.DLL
API-MS-WIN-CORE-VERSION-L1-1-1.DLL
API-MS-WIN-CORE-VERSION-PRIVATE-L1-1-0.DLL
API-MS-WIN-CORE-VERSIONANSI-L1-1-1.DLL
API-MS-WIN-CORE-WINRT-ERRORPRIVATE-L1-1-1.DLL
API-MS-WIN-CORE-WINRT-L1-1-0.DLL
API-MS-WIN-CORE-WINRT-PROPERTYSETPRIVATE-L1-1-0.DLL
API-MS-WIN-CORE-WINRT-PROPERTYSETPRIVATE-L1-1-1.DLL
API-MS-WIN-CORE-WINRT-REGISTRATION-L1-1-0.DLL
API-MS-WIN-CORE-WINRT-ROBUFFER-L1-1-0.DLL
API-MS-WIN-CORE-WINRT-STRING-L1-1-0.DLL
API-MS-WIN-COREUI-SECRUNTIME-L1-1-0.DLL
API-MS-WIN-CRT-LOCALE-L1-1-0.DLL
API-MS-WIN-CRT-PRIVATE-L1-1-0.DLL
API-MS-WIN-CRT-RUNTIME-L1-1-0.DLL
API-MS-WIN-CRT-STRING-L1-1-0.DLL
API-MS-WIN-CRT-TIME-L1-1-0.DLL
API-MS-WIN-DEVICES-QUERY-L1-1-1.DLL
API-MS-WIN-DOWNLEVEL-ADVAPI32-L1-1-0.DLL
API-MS-WIN-DOWNLEVEL-ADVAPI32-L2-1-0.DLL
API-MS-WIN-DOWNLEVEL-KERNEL32-L2-1-0.DLL
API-MS-WIN-DOWNLEVEL-NORMALIZ-L1-1-0.DLL
API-MS-WIN-DOWNLEVEL-OLE32-L1-1-0.DLL
API-MS-WIN-DOWNLEVEL-SHELL32-L1-1-0.DLL
API-MS-WIN-DOWNLEVEL-SHLWAPI-L1-1-0.DLL
API-MS-WIN-DOWNLEVEL-SHLWAPI-L2-1-0.DLL
API-MS-WIN-DOWNLEVEL-SHLWAPI-L2-1-1.DLL
API-MS-WIN-DOWNLEVEL-USER32-L1-1-0.DLL
API-MS-WIN-DOWNLEVEL-VERSION-L1-1-0.DLL
API-MS-WIN-DX-D3DKMT-L1-1-0.DLL
API-MS-WIN-DX-D3DKMT-L1-1-1.DLL
API-MS-WIN-EVENTING-LEGACY-L1-1-0.DLL
API-MS-WIN-EVENTING-OBSOLETE-L1-1-0.DLL
API-MS-WIN-EVENTING-TDH-L1-1-0.DLL
API-MS-WIN-EVENTLOG-LEGACY-L1-1-0.DLL
API-MS-WIN-GDI-DPIINFO-L1-1-0.DLL
API-MS-WIN-MM-JOYSTICK-L1-1-0.DLL
API-MS-WIN-MM-MISC-L2-1-0.DLL
API-MS-WIN-MM-MME-L1-1-0.DLL
API-MS-WIN-MM-TIME-L1-1-0.DLL
API-MS-WIN-NTUSER-IE-MESSAGE-L1-1-0.DLL
API-MS-WIN-NTUSER-SYSPARAMS-L1-1-0.DLL
API-MS-WIN-OLE32-IE-L1-1-0.DLL
API-MS-WIN-POWER-BASE-L1-1-0.DLL
API-MS-WIN-POWER-SETTING-L1-1-0.DLL
API-MS-WIN-RTCORE-NTUSER-CLIPBOARD-L1-1-0.DLL
API-MS-WIN-RTCORE-NTUSER-PRIVATE-L1-1-0.DLL
API-MS-WIN-RTCORE-NTUSER-PRIVATE-L1-1-1.DLL
API-MS-WIN-RTCORE-NTUSER-SYNCH-L1-1-0.DLL
API-MS-WIN-RTCORE-NTUSER-WINDOW-L1-1-0.DLL
API-MS-WIN-SECURITY-ACCESSHLPR-L1-1-0.DLL
API-MS-WIN-SECURITY-ACTIVEDIRECTORYCLIENT-L1-1-0.DLL
API-MS-WIN-SECURITY-ACTIVEDIRECTORYCLIENT-L1-1-1.DLL
API-MS-WIN-SECURITY-BASE-L1-1-0.DLL
API-MS-WIN-SECURITY-CAPABILITY-L1-1-0.DLL
API-MS-WIN-SECURITY-CREDENTIALS-L1-1-0.DLL
API-MS-WIN-SECURITY-CREDENTIALS-L2-1-0.DLL
API-MS-WIN-SECURITY-GROUPPOLICY-L1-1-0.DLL
API-MS-WIN-SECURITY-LSALOOKUP-L1-1-1.DLL
API-MS-WIN-SECURITY-LSALOOKUP-L1-1-2.DLL
API-MS-WIN-SECURITY-LSALOOKUP-L2-1-1.DLL
API-MS-WIN-SECURITY-LSAPOLICY-L1-1-0.DLL
API-MS-WIN-SECURITY-PROVIDER-L1-1-0.DLL
API-MS-WIN-SECURITY-SDDL-L1-1-0.DLL
API-MS-WIN-SECURITY-SDDLPARSECOND-L1-1-0.DLL
API-MS-WIN-SERVICE-WINSVC-L1-1-0.DLL
API-MS-WIN-SHCORE-COMHELPERS-L1-1-0.DLL
API-MS-WIN-SHCORE-OBSOLETE-L1-1-0.DLL
API-MS-WIN-SHCORE-REGISTRY-L1-1-1.DLL
API-MS-WIN-SHCORE-SCALING-L1-1-1.DLL
API-MS-WIN-SHCORE-STREAM-L1-1-0.DLL
API-MS-WIN-SHCORE-STREAM-WINRT-L1-1-0.DLL
API-MS-WIN-SHCORE-SYSINFO-L1-1-0.DLL
API-MS-WIN-SHCORE-THREAD-L1-1-0.DLL
API-MS-WIN-SHCORE-UNICODEANSI-L1-1-0.DLL
API-MS-WIN-SHLWAPI-IE-L1-1-0.DLL
API-MS-WIN-SHLWAPI-WINRT-STORAGE-L1-1-1.DLL
DEVICELOCKHELPERS.DLL
EMCLIENT.DLL
EXT-MS-MF-PAL-L2-1-0.DLL
EXT-MS-ONECORE-APPCHROMEAPI-L1-1-0.DLL
EXT-MS-ONECORE-APPMODEL-VEVENTDISPATCHER-L1-1-0.DLL
EXT-MS-ONECORE-DCOMP-L1-1-0.DLL
EXT-MS-ONECORE-ORIENTATION-L1-1-0.DLL
EXT-MS-ONECORE-PHONEINFO-L1-1-0.DLL
EXT-MS-ONECORE-SHELLCHROMEAPI-L1-1-1.DLL
EXT-MS-WIN-ADVAPI32-EVENTINGCONTROLLER-L1-1-0.DLL
EXT-MS-WIN-ADVAPI32-MSI-L1-1-0.DLL
EXT-MS-WIN-ADVAPI32-NPUSERNAME-L1-1-0.DLL
EXT-MS-WIN-ADVAPI32-NTMARTA-L1-1-0.DLL
EXT-MS-WIN-ADVAPI32-PSM-APP-L1-1-0.DLL
EXT-MS-WIN-ADVAPI32-REGISTRY-L1-1-0.DLL
EXT-MS-WIN-ADVAPI32-SAFER-L1-1-0.DLL
EXT-MS-WIN-APPCOMPAT-APPHELP-L1-1-0.DLL
EXT-MS-WIN-APPMODEL-DEPLOYMENT-L1-1-1.DLL
EXT-MS-WIN-APPMODEL-STATE-EXT-L1-2-0.DLL
EXT-MS-WIN-APPMODEL-USERCONTEXT-L1-1-0.DLL
EXT-MS-WIN-APPMODEL-VIEWSCALEFACTOR-L1-1-0.DLL
EXT-MS-WIN-APPXDEPLOYMENTCLIENT-APPXDEPLOY-L1-1-0.DLL
EXT-MS-WIN-APPXDEPLOYMENTCLIENT-APPXDEPLOYONECORE-L1-1-0.DLL
EXT-MS-WIN-AUDIOCORE-PAL-L1-1-1.DLL
EXT-MS-WIN-AUTHZ-CONTEXT-L1-1-0.DLL
EXT-MS-WIN-AUTHZ-REMOTE-L1-1-0.DLL
EXT-MS-WIN-COM-CLBCATQ-L1-1-0.DLL
EXT-MS-WIN-COM-COML2-L1-1-1.DLL
EXT-MS-WIN-COM-OLE32-L1-1-1.DLL
EXT-MS-WIN-COM-OLE32-L1-1-3.DLL
EXT-MS-WIN-COM-PSMREGISTER-L1-1-0.DLL
EXT-MS-WIN-COM-SUSPENDRESILIENCY-L1-1-0.DLL
EXT-MS-WIN-CORE-WINRT-REMOTE-L1-1-0.DLL
EXT-MS-WIN-DEVMGMT-POLICY-L1-1-0.DLL
EXT-MS-WIN-DOMAINJOIN-NETJOIN-L1-1-0.DLL
EXT-MS-WIN-DWMAPIDXGI-EXT-L1-1-0.DLL
EXT-MS-WIN-EDPUTIL-POLICY-L1-1-0.DLL
EXT-MS-WIN-FAMILYSAFETY-CHILDACCOUNT-L1-1-0.DLL
EXT-MS-WIN-FECLIENT-ENCRYPTEDFILE-L1-1-0.DLL
EXT-MS-WIN-FIREWALLAPI-WEBPROXY-L1-1-0.DLL
EXT-MS-WIN-GDI-DC-CREATE-L1-1-1.DLL
EXT-MS-WIN-GDI-DC-L1-2-0.DLL
EXT-MS-WIN-GDI-DEVCAPS-L1-1-0.DLL
EXT-MS-WIN-GDI-DRAW-L1-1-1.DLL
EXT-MS-WIN-GDI-DRAW-L1-1-2.DLL
EXT-MS-WIN-GDI-FONT-L1-1-1.DLL
EXT-MS-WIN-GDI-FONT-L1-1-2.DLL
EXT-MS-WIN-GDI-METAFILE-L1-1-1.DLL
EXT-MS-WIN-GDI-PATH-L1-1-0.DLL
EXT-MS-WIN-GDI-RENDER-L1-1-0.DLL
EXT-MS-WIN-GPAPI-GROUPPOLICY-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-APPCOMPAT-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-DATETIME-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-ERRORHANDLING-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-FILE-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-LOCALIZATION-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-PACKAGE-CURRENT-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-PACKAGE-L1-1-1.DLL
EXT-MS-WIN-KERNEL32-QUIRKS-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-QUIRKS-L1-1-1.DLL
EXT-MS-WIN-KERNEL32-REGISTRY-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-SIDEBYSIDE-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-WINDOWSERRORREPORTING-L1-1-0.DLL
EXT-MS-WIN-KERNEL32-WINDOWSERRORREPORTING-L1-1-1.DLL
EXT-MS-WIN-KERNELBASE-PROCESSTHREAD-L1-1-0.DLL
EXT-MS-WIN-MININPUT-INPUTHOST-L1-1-0.DLL
EXT-MS-WIN-MPR-MULTIPLEPROVIDERROUTER-L1-1-0.DLL
EXT-MS-WIN-MRMCORER-ENVIRONMENT-L1-1-0.DLL
EXT-MS-WIN-MRMCORER-RESMANAGER-L1-1-0.DLL
EXT-MS-WIN-NTDSAPI-ACTIVEDIRECTORYCLIENT-L1-1-0.DLL
EXT-MS-WIN-NTDSAPI-ACTIVEDIRECTORYCLIENT-L1-1-1.DLL
EXT-MS-WIN-NTUSER-DC-ACCESS-EXT-L1-1-0.DLL
EXT-MS-WIN-NTUSER-DIALOGBOX-L1-1-1.DLL
EXT-MS-WIN-NTUSER-DIALOGBOX-L1-1-2.DLL
EXT-MS-WIN-NTUSER-DRAW-L1-1-1.DLL
EXT-MS-WIN-NTUSER-DRAW-L1-1-2.DLL
EXT-MS-WIN-NTUSER-GUI-L1-3-0.DLL
EXT-MS-WIN-NTUSER-KEYBOARD-L1-1-1.DLL
EXT-MS-WIN-NTUSER-KEYBOARD-L1-2-0.DLL
EXT-MS-WIN-NTUSER-MENU-L1-1-2.DLL
EXT-MS-WIN-NTUSER-MESSAGE-L1-1-1.DLL
EXT-MS-WIN-NTUSER-MESSAGE-L1-1-2.DLL
EXT-MS-WIN-NTUSER-MISC-L1-3-0.DLL
EXT-MS-WIN-NTUSER-MISC-L1-5-0.DLL
EXT-MS-WIN-NTUSER-MOUSE-L1-1-0.DLL
EXT-MS-WIN-NTUSER-PRIVATE-L1-2-0.DLL
EXT-MS-WIN-NTUSER-RECTANGLE-EXT-L1-1-0.DLL
EXT-MS-WIN-NTUSER-ROTATIONMANAGER-L1-1-0.DLL
EXT-MS-WIN-NTUSER-STRING-L1-1-0.DLL
EXT-MS-WIN-NTUSER-SYNCH-L1-1-0.DLL
EXT-MS-WIN-NTUSER-UICONTEXT-EXT-L1-1-0.DLL
EXT-MS-WIN-NTUSER-WINDOW-L1-1-1.DLL
EXT-MS-WIN-NTUSER-WINDOW-L1-1-3.DLL
EXT-MS-WIN-NTUSER-WINDOWCLASS-L1-1-1.DLL
EXT-MS-WIN-NTUSER-WINDOWSTATION-L1-1-1.DLL
EXT-MS-WIN-OLE32-BINDCTX-L1-1-0.DLL
EXT-MS-WIN-OLE32-IE-EXT-L1-1-0.DLL
EXT-MS-WIN-OLE32-OLEAUTOMATION-L1-1-0.DLL
EXT-MS-WIN-PROFILE-EXTENDER-L1-1-0.DLL
EXT-MS-WIN-PROFILE-LOAD-L1-1-0.DLL
EXT-MS-WIN-PROFILE-USERENV-L1-1-0.DLL
EXT-MS-WIN-PROFILE-USERENV-L1-1-1.DLL
EXT-MS-WIN-RPC-SSL-L1-1-0.DLL
EXT-MS-WIN-RTCORE-GDI-DEVCAPS-L1-1-0.DLL
EXT-MS-WIN-RTCORE-GDI-OBJECT-L1-1-0.DLL
EXT-MS-WIN-RTCORE-GDI-RGN-L1-1-0.DLL
EXT-MS-WIN-RTCORE-GDI-RGN-L1-1-1.DLL
EXT-MS-WIN-RTCORE-MINUSER-PRIVATE-EXT-L1-1-0.DLL
EXT-MS-WIN-RTCORE-NTUSER-CURSOR-L1-1-0.DLL
EXT-MS-WIN-RTCORE-NTUSER-DC-ACCESS-L1-1-0.DLL
EXT-MS-WIN-RTCORE-NTUSER-IAM-L1-1-0.DLL
EXT-MS-WIN-RTCORE-NTUSER-INTEGRATION-L1-1-0.DLL
EXT-MS-WIN-RTCORE-NTUSER-SYNCH-EXT-L1-1-0.DLL
EXT-MS-WIN-RTCORE-NTUSER-SYSCOLORS-L1-1-0.DLL
EXT-MS-WIN-RTCORE-NTUSER-SYSPARAMS-L1-1-0.DLL
EXT-MS-WIN-RTCORE-NTUSER-WINDOW-EXT-L1-1-0.DLL
EXT-MS-WIN-SECUR32-TRANSLATENAME-L1-1-0.DLL
EXT-MS-WIN-SECURITY-CAPAUTHZ-L1-1-0.DLL
EXT-MS-WIN-SECURITY-CHAMBERS-L1-1-0.DLL
EXT-MS-WIN-SECURITY-CREDUI-L1-1-0.DLL
EXT-MS-WIN-SECURITY-EFS-L1-1-0.DLL
EXT-MS-WIN-SECURITY-EFSWRT-L1-1-1.DLL
EXT-MS-WIN-SESSION-USERMGR-L1-1-0.DLL
EXT-MS-WIN-SESSION-USERTOKEN-L1-1-0.DLL
EXT-MS-WIN-SESSION-WINSTA-L1-1-0.DLL
EXT-MS-WIN-SESSION-WTSAPI32-L1-1-0.DLL
EXT-MS-WIN-SETUPAPI-INF-L1-1-0.DLL
EXT-MS-WIN-SHELL-DIRECTORY-L1-1-0.DLL
EXT-MS-WIN-SHELL-PROPSYS-L1-1-0.DLL
EXT-MS-WIN-SHELL-SHELL32-L1-2-0.DLL
EXT-MS-WIN-SHELL-SHLWAPI-L1-1-0.DLL
EXT-MS-WIN-SHELL32-SHELLCOM-L1-1-0.DLL
EXT-MS-WIN-SXS-OLEAUTOMATION-L1-1-0.DLL
EXT-MS-WIN-UI-VIEWMANAGEMENT-L1-1-0.DLL
EXT-MS-WIN-USP10-L1-1-0.DLL
EXT-MS-WIN-WER-UI-L1-1-0.DLL
EXT-MS-WIN-WER-XBOX-L1-1-0.DLL
EXT-MS-WIN-WINRT-STORAGE-L1-1-0.DLL
EXT-MS-WIN-WLAN-ONEXUI-L1-1-0.DLL
IESHIMS.DLL

Good Afternoon,

This is the Imaging Science group from R.I.T. once again we have been working with your code and now we have two Kinects running simultaneously to account for the occlusion of our scene. We were wondering if there was some code readily available that you may have worked on in the past to run two Kinects on one system using the SingleHandTracking.py code.

Very Respectfully,
Innovative Freshman Group RIT
1-716-421-4181
[email protected]

I followed the guide to start the programme whose input was the image from the kinnect2. And the computer could follow my gesture. But the problem is that during this process, the video would pause for a few seconds after working for a few seconds. Woking, pausing, working, and pausing , ...，whihc was disturbing. Is this phenomenon right? Is there anyone who are confronted with this problem? Or just because of the setup of my conputer?

I'm not quite sure what this error is or how to fix it. What does this mean?

This occurred while running the runme.sh script on Ubuntu 14.04.

MBV_LIBS Environment variable should point to the MBV libraries folder.
MBV_LIBS /home/cameron/Project/HandTracker/MBV_PythonAPI_Linux_1.1/
Setting LD_LIBRARY_PATH and PYTHONPATH
Running the Single Hand Tracker script...
Creating Renderer...
[2015-11-16 17:25:28.911455] [0x000007fcaad6c574] [warning] Read options from environment : unrecognised option 'libs'
[2015-11-16 17:25:28.911608] [0x000007fcaad6c574] [warning] Read options from environment : unrecognised option 'libs'
Traceback (most recent call last):
  File "src/SingleHandTracking.py", line 33, in <module>
    renderer = Rendering.RendererOGLCudaExposed.get()
RuntimeError: /home/padeler/work/mbv/release_libs/src/mbv/Rendering/RendererOGL/OpenGLHelpers.cpp(158): Throw in function void OGL::ThrowOnCompileLinkError(GLuint, OGL::CompLinkMode, const String&)
Dynamic exception type: boost::exception_detail::clone_impl<MBV::Core::Exception>
[MBV::Core::Message*] = error while compiling file :
ERROR: 0:1: '' :  version '330' is not supported
ERROR: 0:1: '' : syntax error: #version
ERROR: 0:2: 'g_viewMatrices' : syntax error: syntax error

Running the script results in and error

Traceback (most recent call last):
File "src/SingleHandTracking.py", line 8, in
import PyMBVCore as Core
ImportError: /home/eich/devel/MBV_PythonAPI_Linux_1.1/libs/libCore.so: undefined symbol: ZN2cv9ExceptionC1EiRKSsS2_S2

System: CUDA 7.5, NVIDIA 352, Ubuntu 15.10

Hello, when I run ./runme.sh I get this error message:

Starting Grabber...
[2016-07-24 22:30:00.887199] [0x000007f0828f7d74] [error]   Xn function Failed: The file is corrupted!
[2016-07-24 22:30:00.887262] [0x000007f0828f7d74] [error]   Failed to initialize openni_acquisition plugin. /home/padeler/work/mbv/release_libs/src/mbv/Acquisition/OpenNIGrabber/OpenNIGrabber.cpp(171): Throw in function void MBV::Acquisition::OpenNIGrabber::xnCheckReturnCode(int)
Dynamic exception type: boost::exception_detail::clone_impl<MBV::Core::Exception>
[MBV::Core::Message*] = OpenNI error. Function Failed

Below is all the output, hope it is useful:

MBV_LIBS Environment variable should point to the MBV libraries folder.
MBV_LIBS /home/liming/MBV_PythonAPI_Linux_1.1/
Setting LD_LIBRARY_PATH and PYTHONPATH
Running the Single Hand Tracker script...
Creating Renderer...
[2016-07-24 22:30:00.396921] [0x000007f0828f7d74] [warning] Read options from environment : unrecognised option 'libs'
[2016-07-24 22:30:00.397027] [0x000007f0828f7d74] [warning] Read options from environment : unrecognised option 'libs'
  Warning! Material file '/home/liming/HandTracker-master/media/sphere.mtl' not found!
Warning! Material '' not defined in material file.
  Warning! Material file '/home/liming/HandTracker-master/media/cylinder.mtl' not found!
Warning! Material '' not defined in material file.
Variances:  [10.0, 10.0, 10.0, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1]
Low Bounds:  [-2000.0, -2000.0, -2000.0, -1.0, -1.0, -1.0, -1.0, 0.0, 1.2999999523162842, 0.0, 0.0, 0.0, 2.5, 0.0, 0.0, 0.0, 1.2999999523162842, 0.0, 0.0, 0.0, 1.2999999523162842, 0.0, 0.0, 0.0, 1.2999999523162842, 0.0, 0.0]
High Bounds:  [2000.0, 2000.0, 2000.0, 1.0, 1.0, 1.0, 1.0, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874, 1.0, 3.140000104904175, 1.5700000524520874, 1.5700000524520874, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874, 1.5700000524520874, 1.840000033378601, 1.5700000524520874, 1.5700000524520874]
Randomization Indices:  [7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26]
Starting Grabber...
[2016-07-24 22:30:00.887199] [0x000007f0828f7d74] [error]   Xn function Failed: The file is corrupted!
[2016-07-24 22:30:00.887262] [0x000007f0828f7d74] [error]   Failed to initialize openni_acquisition plugin. /home/padeler/work/mbv/release_libs/src/mbv/Acquisition/OpenNIGrabber/OpenNIGrabber.cpp(171): Throw in function void MBV::Acquisition::OpenNIGrabber::xnCheckReturnCode(int)
Dynamic exception type: boost::exception_detail::clone_impl<MBV::Core::Exception>
[MBV::Core::Message*] = OpenNI error. Function Failed

Entering main Loop.
Traceback (most recent call last):
  File "src/SingleHandTracking.py", line 127, in <module>
    c = clbs[0]
IndexError: Index out of range

Besides, I use Ubuntu 14.04 , OpenNI and a kinect v1, when I run NiViewer, it works fine.

Hello, thanks for your work. I am working with Kinect to do some research.

I received the following import error.

MBV_LIBS Environment variable should point to the MBV libraries folder.
MBV_LIBS D:\MBV_PythonAPI_Win_1.1
Setting PATH and PYTHONPATH
"Running the Single Hand Tracker script..."
Traceback (most recent call last):
File "src\SingleHandTracking.py", line 10, in
import PyMBVAcquisition as Acquisition
ImportError: DLL load failed: The specified module could not be found.

If I commented on line 10, I would get this:

File "src\SingleHandTracking.py", line 17, in
import PyHandTracker as HT

I only had problems with these two DLLs. That is to say, if I had commented these two lines, the 'import' part worked. What happened?
Thank you for your kind attention.

Good Afternoon,

I am with a group at Rochester Institute of Technology and we have been working with your "SingleHandTracking.py". We have been looking for a way to track the individual meshes located on the fingertips of the hand rendering. We are currently able to print out a converted numpy array of the variable currentHandPose and from this we obtain 27 values. We are wondering what these values represent, and if they can help us in tracking the position of the individual fingertips on the hand.

We were also wondering how you were able to create object files and render them with the hand in the videos you provided. Could we write something in your python code to integrate .obj files within your code. The reason we ask this is that we aim to try to track the hand as it holds an object, and occlusion one of our concerns. We are wondering how we could incorporate our own .obj files, since the object the hand holds is irregular in nature. Would you be able to recommend any other methods of dealing with occlusion?

Very Respectfully,

Emmanuel Palad, Kaitlyn Emerson, Dominic Curcione
Rochester Institute of Technology
716-421-4181
[email protected]

I saw the online demo here: http://cvrlcode.ics.forth.gr/handtracking/?page_id=7#a_contact. And I wonder whether the provided libs(http://cvrlcode.ics.forth.gr/files/mbv/v1.1/MBV_PythonAPI_Linux_1.1.zip) support this function. If yes, can you provide an online demo python code? Or some documentation.

@Sahbaap asks in #8 : "how fast my hands can be moved that the handtracker does not the get lost? cuz I noticed if I move my hands fast it does get lost."

these following warning OK?
[2016-03-14 19:11:15.527911] [0x00000104] [warning] Read options from environment : unrecognised option 'libs'
[2016-03-14 19:11:15.543520] [0x00000104] [warning] Read options from environment : unrecognised option 'libs'
Warning! Material file 'F:\FORTH\HANDTRACKER1\media\sphere.mtl' not found!
Warning! Material '' not defined in material file.
Warning! Material file 'F:\FORTH\HANDTRACKER1\media\cylinder.mtl' not found!
Warning! Material '' not defined in material file.

Hi,

I failed to make the handtracker work with openni directly, so I am trying to implement the handtracker in ROS using openni_launch to provide the rgb and depth feed. I am now stuck in creating the view and projection matrices, can someone please print both viewMatrix and projectionMatrix and show me how these should look like?

Thanks
M