This is a python scarpy web crawler using which we can download images of pokemons and thereby maintain a cool pokemon digital card collection :p
Give below are the steps to install a few tools inorder to meet the requirements.
INSTALLATION :
- $ sudo apt-get install python-lxml libffi-dev
- $ sudo pip install Scrapy
- $ sudo pip install service_identity
- $ sudo pip uninstall pillow
- $ sudo apt-get install libjpeg-dev
- $ sudo pip install -I pillow
QUICK START :
Run the following commands.
- git clone https://github.com/Ashritha28/PokemonCrawler.git
- cd PokemonCrawler
- scrapy crawl PokeSpider
NOTE :
You can find all the downloaded images in https://github.com/Ashritha28/PokemonCrawler/tree/master/PokemonImagesFolder