Simple text analysis from the command line.
Homepage: http://learntextvis.github.io/textkit/
textkit is a series of small, unix-style tools that provide a suite of capabilities for dealing with text as data.
Think of textkit as basic natural language processing capabilities - from the command line.
Here are some of the cool things you can do with textkit.
Convert a document to a set of word tokens and remove all punctuation from the tokens:
textkit text2words input.txt | textkit filterpunc
Count top used words in a text:
textkit text2words alice.txt | textkit count --limit 20
Do the same, but with punctuation removed:
textkit text2words alice.txt | textkit filterpunc | textkit count --limit 20
$ pip install -U textkit $ textkit --help
To test locally, clone the repo:
git clone [email protected]:learntextvis/textkit.git
Create a local virtual environment or conda environment.
Here is how I created my local conda environment for installing and testing textkit:
conda create --name textkit nltk source activate textkit
Then I went into the textkit directory to install its requirements
cd textkit pip install -r requirements.txt
Finally, I installed the local version of textkit using the --editable flag:
pip install --editable .
See more examples at the Quickstart guide.
- Python >= 2.6 or >= 3.3