mbernico / cs570 Goto Github PK

hye what is the corpus that u are using in there , mean while can you explain me how to add a corpus of my own

Hi!
I'm using LSA Text.ipynb.
But when executing the code
lsa.components_[0]
The error message

AttributeError: 'TruncatedSVD' object has no attribute 'components_'

How can I solve this problem?
I'm using python 2.7 in Anaconda environment, but I tried in Eclipse Pydev, same problem exists.
Here is the code
# -*- coding: utf-8 -*-
from bs4 import BeautifulSoup
import nltk
from nltk.corpus import stopwords
from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn.decomposition import TruncatedSVD
posts = open('raw_forum_posts.dat','r').read()
soup = BeautifulSoup(posts, "lxml")
postTxt = soup.findAll('text')
postDocs = [x.text for x in postTxt]
postDocs.pop(0)
postDocs = [x.lower() for x in postDocs]
stopset = set(stopwords.words('english'))
stopset.update(['lt','p','/p','br','amp','quot','field' ])
vectorizer = TfidfVectorizer(stop_words=stopset, use_idf=True, ngram_range=(1, 3))
X = vectorizer.fit_transform(postDocs)
lsa = TruncatedSVD(n_components=27, n_iter=100)
lsa.components_[0]