magsilva / dtm Goto Github PK

Dear Jeffrey,

Hi. My name is Sang Won Han, and I am writing to you to ask you some questions regarding your Python module, "dtmpy." I would like to use document influence model, and there are some descriptions that dim is possible, but when I executed the dtmpy, it doesn't seem that dim is possible. Is there any way that I can use document influence model with Python? I tried to compile C-based dtm/dim files posted on Blei's github, but it produces many errors so I have no idea how to deal with them. Please let me know. Thanks!

Best,

Sang Won

Hi,

I was able to compile using make. However when I try to run using the instructions from https://markroxor.github.io/gensim/static/notebooks/dtm_example.html

I get the following error:
*** glibc detected *** /n/home09/hxue/dtm/bin/dtm-linux64: free(): invalid pointer: 0x000000000061cc18 *** ======= Backtrace: ========= /lib64/libc.so.6(+0x75e66)[0x2b396cbfbe66] /n/sw/fasrcsw/apps/Core/gcc/7.1.0-fasrc01/lib64/libstdc++.so.6(_ZNSs6assignERKSs+0x92)[0x2b396c40eca2] /n/sw/fasrcsw/apps/Core/gflags/2.1.2-fasrc01/lib/libgflags.so.2(+0x6dbb)[0x2b396c124dbb] /n/sw/fasrcsw/apps/Core/gflags/2.1.2-fasrc01/lib/libgflags.so.2(+0x8caf)[0x2b396c126caf] /n/sw/fasrcsw/apps/Core/gflags/2.1.2-fasrc01/lib/libgflags.so.2(+0x9ce7)[0x2b396c127ce7] /n/home09/hxue/dtm/bin/dtm-linux64[0x4162fc] /lib64/libc.so.6(__libc_start_main+0xfd)[0x2b396cba4d5d] /n/home09/hxue/dtm/bin/dtm-linux64[0x402ea9]
Alternatively, I also tried directly running the precompiled binary and ran into the following error:
./dtm-linux64: error while loading shared libraries: libgsl.so.23: cannot open shared object file: No such file or directory
Any idea what might be going wrong here?

Thanks!

Hi magsilva.

Just as a reference for future users (and, quite likely, myself), let me leave a record of how to compile this project for M1 and M2 mac users.

I installed gsl and gflags using brew.

brew install gsl
brew install gflags

brew places the headers and the libraries in

/opt/homebrew/Cellar/gsl/2.7.1
/opt/homebrew/Cellar/gflags/2.2.2

This means that one needs to change the Makefile's CXX flags as follows:

# Line 8 in the Makefile
CXXFLAGS += -I /opt/homebrew/Cellar/gsl/2.7.1/include -L /opt/homebrew/Cellar/gsl/2.7.1/lib -I /opt/homebrew/Cellar/gflags/2.2.2/include -L /opt/homebrew/Cellar/gflags/2.2.2/lib -I ${LIB} -I ${LIB}/math -I ${GSLWRAP_LIB}/include -I ${GSLWRAP_LIB}/include/gslwrap 

This change allows you to compile in the new architectures.

When I tried to run the dtm-win64.exe file, its opening and momentarily getting closed. Please provide me with a solution for this.

I'm trying to calculate the perplexity of a model based on the lhoods.dat file but I can find how to do it. What would be the correct way to calculate it? Thanks.

Is there a release for Windows 10?

The dtm-win64.exe file is not compatible !