Scrape Amazon products with scrape and python 2
Scrapy is an application framework and it provides many commands to create applications and use them. Before creating an application, one will have to set up a new Scrapy project. Enter a directory where you’d like to store your code and run: scrapy startproject amazon
How to install Scrapy ? Following are third party softwares and packages which need to be installed in order to install Scrapy in a system. Python : As Scrapy has been built using Python language, one has to install it first. pip : pip is a python package manager tool which maintains a package repository and install python libraries, and its dependencies automatically. It is better to install pip according to system OS, and then try to follow the standard way for installing Scrapy. lxml : This is an optional package but needs to be installed if one is willing to scrap html data. lxml is a python library which helps to structure html tree, as web pages use html hierarchy to organise information or Data. One can install Scrapy using pip (which is the canonical way to install Python packages). To install using Scrapy, run: pip install scrapy
- python 2 - The language uused
- [scrapy] - Library
I use python 2 for versioning.