TinySegmenter is a Clojure library which splits Japanese into words. This is needed because the Japanese stubbornly refuse to use the spacebar.

This library is just a Clojure port of the TinySegmenter javascript library by Taku Kudo ([email protected]). This version is based on the Python 3 version of TinySegmenter

The library only exports a single function segment, which takes a string (or any char sequence) as an argument.

(require '[tinysegmenter.core :refer [segment]])

(= (segment "私の名前はFelixです")
   ["私" "の" "名前" "は" "Felix" "です"])

TinySegmenter is available on Clojars

Leiningen

[com.github.funkschy/tinysegmenter "0.1.0"]

Clojure CLI/deps.edn

com.github.funkschy/tinysegmenter {:mvn/version "0.1.0"}

This project is distributed under the BSD 3 License, just like the original version by Taku Kudo. See the LICENSE file for more information.