Giter VIP home page Giter VIP logo

textnet-release's Introduction

TextNet

TextNet is a deep neural netwrok framework for text matching tasks.

Quick Start

  1. Make a copy of Makefile.config.example.
cp Makefile.config.example Makefile.config
  1. Setting the environment path in Makefile.config.

  2. Compile it!

mkdir bin
make all -j 16
  1. Wirte you own network config file in json. You can find examples in Textnet Model.

  2. Run!

./bin/textnet [model_file]

Features

Dependences

Version

v1.0

Related Projects

Acknowledgements

The following people contributed to the development of the TextNet project:

  • Liang Pang
  • Shengxian Wan
    • Institute of Computing Technolgy, Chinese Academy of Sciences
    • Google Scholar
  • Yixing Fan
    • Institute of Computing Technolgy, Chinese Academy of Sciences
    • Google Scholar
  • Yanyan Lan
    • Institute of Computing Technolgy, Chinese Academy of Sciences
    • HomePage
  • Jiafeng Guo
    • Institute of Computing Technolgy, Chinese Academy of Sciences
    • HomePage
  • Jun Xu
    • Institute of Computing Technolgy, Chinese Academy of Sciences
    • HomePage
  • Xueqi Cheng
    • Institute of Computing Technolgy, Chinese Academy of Sciences
    • HomePage

textnet-release's People

Contributors

faneshion avatar oraclewan avatar pl8787 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

textnet-release's Issues

Problems with mkl intel library

I'm getting this error of mkl:
...

/home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_lapack_clacn2' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_pds_sp_pds_sym_indef_diag_fwd_ker_seq_cmplx' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_sparse_s_csc_mv_def_ker_i8' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_spblas_ccoo0nhuuc__mmout_par' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_lapack_ps_dsymv_nb' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_lapack_chesvxx'
/home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_lapack_ssygst' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_blas_xsgemm0_brc' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_spblas_dcsr1nsuuf__mmout_par' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_spblas_cdia1nsunf__mmout_par' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_pds_pds_her_indef_diag_ker_loop_nrhs_cmplx' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_lapack_dlaein'
/home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_lapack_sgtcon' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_lapack_sgesvxx'
/home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_spblas_zcoo1nhunf__mvout_par'
/home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_pds_lp64_pardiso_export_s'
/home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_spblas_zcoo1sd_nf__mmout_par'
/home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to ``mkl_pds_cmovxy'
/home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_pds_lp64_sp_dsytrs_bklfw_noscal_pardiso'
/home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_pds_lp64_sp_pds_unsym_ker_loop_nrhs_cmplx'
/home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_lapack_zlaqgb' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_lapack_zlaed8'
/home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_iss_dcsrilut' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_spblas_lp64_dbsc_gauss' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_lp64.so: undefined reference to mkl_pds_lp64_pardiso_export_c' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_pds_lp64_pds_fct_right_single_cmplx' /home/eneas/intel/mkl/lib/intel64/libmkl_intel_thread.so: undefined reference to mkl_spblas_lp64_ccoo1ng__c__mmout_par' collect2: error: ld returned 1 exit status Makefile:115: recipe for target 'bin/grad_check' failed make: *** [bin/grad_check] Error 1`

the mkl enviropment variable was configured on .profile according to intel site instructions.

How to workaround this?

MV-lstm

Is there some one run the program of MV-LSTM, how to do it ?

some problems with ./bin/textnet

I am trying to compile textnet-release these serval days, but when i finished compiling and execute got this error.

jack@jack-MS-7B47:~/textnet-release$ ./bin/textnet
Error from reader: * Line 1, Column 1
Syntax error: value, object or array expected.
terminate called after throwing an instance of 'Json::RuntimeError'
what(): reader error
已放弃 (核心已转储)

jack@jack-MS-7B47:~/textnet-release$ ldd ./bin/textnet
linux-vdso.so.1 => (0x00007ffce7b80000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f2fbbb85000)
libcblas.so.3 => /usr/lib/libcblas.so.3 (0x00007f2fbb963000)
libzmq.so.5 => /usr/local/lib/libzmq.so.5 (0x00007f2fbb6d3000)
libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f2fbb351000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f2fbb048000)
libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f2fbae32000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f2fbaa68000)
/lib64/ld-linux-x86-64.so.2 (0x00007f2fbbda2000)
libatlas.so.3 => /usr/lib/libatlas.so.3 (0x00007f2fba4ca000)
libgfortran.so.3 => /usr/lib/x86_64-linux-gnu/libgfortran.so.3 (0x00007f2fba19f000)
librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f2fb9f97000)
libquadmath.so.0 => /usr/lib/x86_64-linux-gnu/libquadmath.so.0 (0x00007f2fb9d58000)

I want to know how to solve this problem,have i lost some necessary compile options. anyone can give a detail documentation of the file named Makefile.config.

Problems with make all -j 16 command

After insert make all -j 16 command we get that output:

/usr/bin/g++ -c -O3 -msse3 -Wno-unknown-pragmas -funroll-loops -I./mshadow/ -std=c++11 -pthread -fPIC -I/home/eneas/intel/mkl/include -I/usr/include -I/usr/local/include -I/usr/lib/cuda/include -DMSHADOW_USE_CUDA=0 -DMSHADOW_USE_MKL=1 -DMSHADOW_USE_CBLAS=0 -DREALTIME_SERVER=1 -o net_cpu.o src/net/net_impl.cpp In file included from src/net/net_impl-inl.hpp:5:0, from src/net/net_impl.cpp:4: src/net/./net.h: In member function ‘virtual void textnet::net::Net<xpu>::TestAll(std::__cxx11::string, int)’: src/net/./net.h:885:26: error: there are no arguments to ‘accumulate’ that depend on a template parameter, so a declaration of ‘accumulate’ must be available [-fpermissive] test_loss[i] = accumulate(test_loss_list[i].begin(), test_loss_list[i].end(), 0.0f); ^~~~~~~~~~ src/net/./net.h:885:26: note: (if you use ‘-fpermissive’, G++ will accept your code, but allowing the use of an undeclared name is deprecated) src/net/./net.h:888:26: error: there are no arguments to ‘accumulate’ that depend on a template parameter, so a declaration of ‘accumulate’ must be available [-fpermissive] test_loss[i] = accumulate(test_loss_list[i].begin(), test_loss_list[i].end(), 0.0f); ^~~~~~~~~~ src/net/./net.h: In instantiation of ‘void textnet::net::Net<xpu>::TestAll(std::__cxx11::string, int) [with xpu = mshadow::cpu; std::__cxx11::string = std::__cxx11::basic_string<char>]’: src/net/net_impl.cpp:18:1: required from here src/net/./net.h:885:36: error: ‘accumulate’ was not declared in this scope test_loss[i] = accumulate(test_loss_list[i].begin(), test_loss_list[i].end(), 0.0f); ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ src/net/./net.h:888:36: error: ‘accumulate’ was not declared in this scope test_loss[i] = accumulate(test_loss_list[i].begin(), test_loss_list[i].end(), 0.0f); ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ src/net/./net.h: In member function ‘void textnet::net::Net<xpu>::setLogFile() [with xpu = mshadow::cpu]’: src/net/./net.h:194:14: warning: ignoring return value of ‘FILE* freopen(const char*, const char*, FILE*)’, declared with attribute warn_unused_result [-Wunused-result] freopen(root["log"].asString().c_str(), "a", stdout); ~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Makefile:118: recipe for target 'net_cpu.o' failed make: *** [net_cpu.o] Error 1

Problems with follow instructions of README.md file

First of all, congrats for TextNET framework and I'm beginning in machine learning, so sorry.

I'm trying to run textnet from linux terminal and I'm having some troubles. The quick start introduction, I suppose, assumes the user is familiar with 'make' command and 'makefiles' and maybe mshadow. Well, I'm facing problems especially in this two parts:

  1. make a copy of Makefile.config.example

-Where do I must make this copy, root of textnet directory?

2 - Setting the environment path in Makefile.config

-I'm not familiar with mshadow, BLAST variable etc so what part of file content I must set the path of textnet

3 - Compile it! -> mkdir bin; -> make all -j 16

Suppose I'm in the root directory of textnet, made a copy of makefile.conf and created the bin directory, when I set 'make all -j 16' command the bash output is' make: *** No rule to make target 'all'. Stop ' In the makefile.cong does not have a method or command called 'all'.

So, is another makefile which I must compile or is another makefile name?

Skip step 4 for a while

  1. Run!

./bin/textnet [model_file]

I think textnet is an executable file generated as a result of compilation of step 3, right !? Or should I create this file too? If I must create, what content to set?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.