Giter VIP home page Giter VIP logo

additional_openjtalk_dic's Introduction

additional_openjtalk_dic

ビルド方法

Ubuntu上でのビルドを想定しています。

$ sudo apt-get install -y --no-install-recommends \
        build-essential \
        gcc g++ cmake \
        unzip xz-utils \
        libblas3 libblas-dev \
        mecab libmecab-dev swig \
        locales \
        nkf \
        python3-dev python3-pip python3-setuptools python3-tk

$ git clone --depth 1 --recursive --shallow-submodules https://github.com/takana-v/additional_openjtalk_dic
$ cd additional_openjtalk_dic
$ wget https://ccd.ninjal.ac.jp/unidic_archive/cwj/2.1.2/unidic-mecab_kana-accent-2.1.2_src.zip
$ unzip unidic-mecab_kana-accent-2.1.2_src.zip && cd unidic-mecab_kana-accent-2.1.2_src
$ ./configure && make
$ sudo make install && cd ../
$ find ./mecab-ipadic-neologd/seed/ -type f -name "*.xz" | xargs -I{} unxz -k {}
$ cat ./mecab-ipadic-neologd/seed/*.csv > neologd_all.csv
$ python3 -m pip install --upgrade pip && python3 -m pip install --upgrade setuptools
$ cd tdmelodic
$ python3 -m pip install -r requirements.txt
$ python3 -m pip install .
$ cd ../
$ python3 main.py

最後の行でかなり時間が掛かると思います。
PCによりますが下手すると数日かかるかもしれません。
手元の環境ではneologd_all.csvが5572307行あったので50行/秒で処理するとすると31時間ほどかかります。
additional_openjtalk_dic.csvが完成した辞書ファイルです。

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.