Scrapy is a python library that help you to scrape website data at ease

Use the package manager pip to install foobar.

pip install scrapy

• With great support of a Webinar from Prateek Sir by CodingBlocks i was able to scrape data of a e-commerce website "Flipkart".
• I took a webpage and extracted all product_price, product_name, product_rating upto 5 pages.
• Scraped data is then store in .json, .csv or .xml file and can be used for any purpose.
• Scrapy does all the hard work for us, while we just type few lines of code.
• code consist of the website-url we want to fetch data and css-selectors which contains our data.
• Then using Scrapy command line tools we can start our website scraping.
• On more details on how Scrapy works can be found here.

• Get your all classmates semester marks at one click.(if your university uploads marks at a websites protal)
• Scraping Amazon for specific category of books.
• This method is used in populor serch engines to get relavent pages to your search result

• Prateek Narang
• CodingBlocks
• Webinar