Utilizing Python NLTK (Natural Language Tool Kit) Platform and do the following. Install relevant Packages and Libraries
• Exploring Brown Corpus and finding the size, tokens, categories, • Finding the size of word tokens? • Finding the size of word types? • Finding the size of category “government” • List the most frequent tokens & • Counting the number of sentences
- Exploring the corpora available in NLTK package
DA2-
Creating a text corpus and Implement the following text processing
• Word segmentation • Sentence segmentation • Convert to Lowercase • Stop words removal • Stemming • Lemmatization • Part of speech tagger.