alexeygolovin5587 / boat Goto Github PK

1. Set up the environment for this project

  pip install Scrapy

2. Run the project

 In /boat/boat/

  $ python boat_scrapy.py '{"Marinas":"Carrick on Shannon", "nights":3, "people":4, "date":"24/03/2016"}'

3 Component explanation

	has_table.py: hash table for boat array.
	urlfilter.py: making urls based on input data
	boat_scrapy.py: main file that contains main logic of the project

	have three spiders in 'spiders' folder:

	cruise_ireland_spider.py
	emeraldstar_spider.py
	silber_spider.py

4. Result
	
[{"date": "24/03/2016", "price": "1665.00", "postID": 71}, {"date": "23/03/2016", "price": "1514.00", "postID": 71}, {"date": "25/03/2016", "price": "1665.00", "postID": 71}, {"date": "24/03/2016", "price": "1345.00", "postID": 71}, {"date": "24/03/2016", "price": "1345.00", "postID": 1440}, {"date": "23/03/2016", "price": "1223.00", "postID": 1440}, {"date": "25/03/2016", "price": "1345.00", "postID": 1440}, {"date": "24/03/2016", "price": "1345.00", "postID": 1440}, {"date": "24/03/2016", "price": "1332.00", "postID": 1440}, {"date": "24/03/2016", "price": "1665.00", "postID": 1440}, {"date": "24/03/2016", "price": "1031.00", "postID": 1440}, {"date": "24/03/2016", "price": "552.00", "postID": 70}, {"date": "23/03/2016", "price": "502.00", "postID": 70}, {"date": "25/03/2016", "price": "552.00", "postID": 70}, {"date": "24/03/2016", "price": "552.00", "postID": 70}, {"date": "24/03/2016", "price": "547.00", "postID": 70}, {"date": "24/03/2016", "price": "603.00", "postID": 70}, {"date": "24/03/2016", "price": "509.00", "postID": 70}, {"date": "24/03/2016", "price": "770.00", "postID": 7069}, {"date": "23/03/2016", "price": "700.00", "postID": 7069}, {"date": "25/03/2016", "price": "770.00", "postID": 7069}, {"date": "24/03/2016", "price": "770.00", "postID": 7069}, {"date": "24/03/2016", "price": "762.00", "postID": 7069}, {"date": "24/03/2016", "price": "777.00", "postID": 7069}, {"date": "24/03/2016", "price": "509.00", "postID": 69}, {"date": "23/03/2016", "price": "463.00", "postID": 69}, {"date": "25/03/2016", "price": "509.00", "postID": 69}, {"date": "24/03/2016", "price": "509.00", "postID": 69}, {"date": "24/03/2016", "price": "552.00", "postID": 69}, {"date": "24/03/2016", "price": "498.00", "postID": 69}, {"date": "24/03/2016", "price": "1031.00", "postID": 67}, {"date": "23/03/2016", "price": "937.00", "postID": 67}, {"date": "25/03/2016", "price": "1031.00", "postID": 67}, {"date": "24/03/2016", "price": "1031.00", "postID": 67}, {"date": "24/03/2016", "price": "1345.00", "postID": 67}, {"date": "24/03/2016", "price": "498.00", "postID": 7717}, {"date": "23/03/2016", "price": "453.00", "postID": 7717}, {"date": "25/03/2016", "price": "498.00", "postID": 7717}, {"date": "24/03/2016", "price": "493.00", "postID": 7717}, {"date": "24/03/2016", "price": "498.00", "postID": 7717}, {"date": "24/03/2016", "price": "509.00", "postID": 7717}, {"date": "24/03/2016", "price": "443.00", "postID": 7717}, {"date": "24/03/2016", "price": "443.00", "postID": 66}, {"date": "23/03/2016", "price": "403.00", "postID": 66}, {"date": "25/03/2016", "price": "443.00", "postID": 66}, {"date": "24/03/2016", "price": "439.00", "postID": 66}, {"date": "24/03/2016", "price": "443.00", "postID": 66}, {"date": "24/03/2016", "price": "498.00", "postID": 66}, {"date": "24/03/2016", "price": "777.00", "postID": 1431}, {"date": "23/03/2016", "price": "706.00", "postID": 1431}, {"date": "25/03/2016", "price": "777.00", "postID": 1431}, {"date": "24/03/2016", "price": "777.00", "postID": 1431}, {"date": "24/03/2016", "price": "783.00", "postID": 1431}, {"date": "24/03/2016", "price": "770.00", "postID": 1431}, {"date": "24/03/2016", "price": "783.00", "postID": 7125}, {"date": "23/03/2016", "price": "712.00", "postID": 7125}, {"date": "25/03/2016", "price": "783.00", "postID": 7125}, {"date": "24/03/2016", "price": "783.00", "postID": 7125}, {"date": "24/03/2016", "price": "777.00", "postID": 7125}, {"date": "23/03/2016", "price": "712.00", "postID": 72}, {"date": "5/04/2016", "price": "712.00", "postID": 72}, {"date": "24/03/2016", "price": "783.00", "postID": 72}, {"date": "24/03/2016", "price": "775.00", "postID": 72}, {"date": "24/03/2016", "price": "770.00", "postID": 72}, {"date": "24/03/2016", "price": "603.00", "postID": 72}, {"date": "24/03/2016", "price": "603.00", "postID": 7144}, {"date": "23/03/2016", "price": "548.00", "postID": 7144}, {"date": "25/03/2016", "price": "603.00", "postID": 7144}, {"date": "24/03/2016", "price": "603.00", "postID": 7144}, {"date": "24/03/2016", "price": "552.00", "postID": 7144}, {"date": "24/03/2016", "price": "809.00", "postID": 52}, {"date": "24/03/2016", "price": "1031.00", "postID": 52}, {"date": "24/03/2016", "price": "783.00", "postID": 52}],
[{"date": "25/03/2016", "price": "861", "postID": 1550}, {"date": "25/03/2016", "price": "738", "postID": 1550}, {"date": "29/03/2016", "price": "531", "postID": 1550}, {"date": "30/03/2016", "price": "424", "postID": 1550}, {"date": "24/03/2016", "price": "552", "postID": 1550}, {"date": "25/03/2016", "price": "683", "postID": 1550}, {"date": "28/03/2016", "price": "440", "postID": 1550}, {"date": "28/03/2016", "price": "482", "postID": 1550}, {"date": "28/03/2016", "price": "473", "postID": 1549}, {"date": "25/03/2016", "price": "693", "postID": 1549}, {"date": "29/03/2016", "price": "442", "postID": 1549}, {"date": "25/03/2016", "price": "693", "postID": 1549}, {"date": "29/03/2016", "price": "442", "postID": 1549}, {"date": "25/03/2016", "price": "660", "postID": 1549}, {"date": "25/03/2016", "price": "791", "postID": 1549}, {"date": "28/03/2016", "price": "518", "postID": 1549}, {"date": "30/03/2016", "price": "518", "postID": 1549}, {"date": "25/03/2016", "price": "711", "postID": 1549}, {"date": "28/03/2016", "price": "460", "postID": 1549}, {"date": "30/03/2016", "price": "385", "postID": 1549}, {"date": "18/03/2016", "price": "756", "postID": 1549}, {"date": "21/03/2016", "price": "500", "postID": 1549}, {"date": "25/03/2016", "price": "802", "postID": 1549}, {"date": "31/03/2016", "price": "628", "postID": 1544}, {"date": "31/03/2016", "price": "628", "postID": 1544}, {"date": "30/03/2016", "price": "500", "postID": 1544}, {"date": "30/03/2016", "price": "500", "postID": 1544}, {"date": "25/03/2016", "price": "862", "postID": 1544}, {"date": "26/03/2016", "price": "799", "postID": 1544}, {"date": "12/03/2016", "price": "621", "postID": 1544}, {"date": "14/03/2016", "price": "434", "postID": 1544}, {"date": "16/03/2016", "price": "434", "postID": 1544}, {"date": "19/03/2016", "price": "621", "postID": 1544}, {"date": "21/03/2016", "price": "434", "postID": 1544}, {"date": "23/03/2016", "price": "434", "postID": 1544}, {"date": "25/03/2016", "price": "698", "postID": 1544}, {"date": "18/03/2016", "price": "833", "postID": 1544}, {"date": "21/03/2016", "price": "548", "postID": 1544}, {"date": "25/03/2016", "price": "884", "postID": 1544}, {"date": "28/03/2016", "price": "593", "postID": 1544}, {"date": "24/03/2016", "price": "643", "postID": 1544}, {"date": "25/03/2016", "price": "799", "postID": 1544}, {"date": "28/03/2016", "price": "516", "postID": 1544}, {"date": "31/03/2016", "price": "667", "postID": 1544}, {"date": "24/03/2016", "price": "643", "postID": 1544}, {"date": "25/03/2016", "price": "799", "postID": 1544}, {"date": "28/03/2016", "price": "516", "postID": 1544}, {"date": "25/03/2016", "price": "799", "postID": 1544}, {"date": "28/03/2016", "price": "516", "postID": 1544}, {"date": "27/03/2016", "price": "796", "postID": 1540}, {"date": "28/03/2016", "price": "619", "postID": 1540}, {"date": "30/03/2016", "price": "619", "postID": 1540}, {"date": "31/03/2016", "price": "785", "postID": 1540}, {"date": "25/03/2016", "price": "877", "postID": 1540}, {"date": "25/03/2016", "price": "877", "postID": 1540}, {"date": "30/03/2016", "price": "593", "postID": 1540}, {"date": "28/03/2016", "price": "571", "postID": 1540}, {"date": "31/03/2016", "price": "745", "postID": 1540}, {"date": "30/03/2016", "price": "593", "postID": 1540}, {"date": "25/03/2016", "price": "921", "postID": 1540}, {"date": "28/03/2016", "price": "587", "postID": 1540}, {"date": "28/03/2016", "price": "615", "postID": 1540}, {"date": "25/03/2016", "price": "967", "postID": 1540}, {"date": "30/03/2016", "price": "629", "postID": 1540}, {"date": "12/03/2016", "price": "782", "postID": 1540}, {"date": "23/03/2016", "price": "547", "postID": 1540}, {"date": "29/03/2016", "price": "564", "postID": 1540}, {"date": "25/03/2016", "price": "1,138", "postID": 52}, {"date": "28/03/2016", "price": "747", "postID": 52}, {"date": "25/03/2016", "price": "1,106", "postID": 52}, {"date": "28/03/2016", "price": "726", "postID": 52}, {"date": "31/03/2016", "price": "886", "postID": 52}, {"date": "25/03/2016", "price": "1,106", "postID": 52}, {"date": "28/03/2016", "price": "726", "postID": 52}, {"date": "31/03/2016", "price": "886", "postID": 52}, {"date": "25/03/2016", "price": "1,125", "postID": 52}, {"date": "29/03/2016", "price": "739", "postID": 52}, {"date": "25/03/2016", "price": "1,125", "postID": 52}, {"date": "29/03/2016", "price": "739", "postID": 52}, {"date": "28/03/2016", "price": "800", "postID": 52}, {"date": "25/03/2016", "price": "1,133", "postID": 52}, {"date": "30/03/2016", "price": "732", "postID": 52}, {"date": "25/03/2016", "price": "1,108", "postID": 52}, {"date": "25/03/2016", "price": "1,106", "postID": 52}, {"date": "28/03/2016", "price": "726", "postID": 52}, {"date": "25/03/2016", "price": "643", "postID": 1542}, {"date": "31/03/2016", "price": "493", "postID": 1542}, {"date": "31/03/2016", "price": "493", "postID": 1542}, {"date": "25/03/2016", "price": "655", "postID": 1542}, {"date": "18/03/2016", "price": "660", "postID": 1542}, {"date": "21/03/2016", "price": "438", "postID": 1542}, {"date": "25/03/2016", "price": "701", "postID": 1542}, {"date": "28/03/2016", "price": "474", "postID": 1542}, {"date": "24/03/2016", "price": "489", "postID": 1542}, {"date": "30/03/2016", "price": "393", "postID": 1542}, {"date": "28/03/2016", "price": "418", "postID": 1542}, {"date": "31/03/2016", "price": "530", "postID": 1542}, {"date": "28/03/2016", "price": "418", "postID": 1542}, {"date": "31/03/2016", "price": "530", "postID": 1542}]