wanzixin / getshp Goto Github PK

现在高德地图的反爬机制做的特别好，每个cookie只能爬很少几条数据了

Traceback (most recent call last):
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\getPoiShp.py", line 145, in
main()
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\getPoiShp.py", line 141, in main
p.getPoiId()
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\getPoiShp.py", line 53, in getPoiId
info=self.getRawData(url)
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\getPoiShp.py", line 32, in getRawData
'User-Agent': UserAgent(use_cache_server=False).random,
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\venv\lib\site-packages\fake_useragent\fake.py", line 69, in init
self.load()
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\venv\lib\site-packages\fake_useragent\fake.py", line 75, in load
self.data = load_cached(
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\venv\lib\site-packages\fake_useragent\utils.py", line 250, in load_cached
update(path, use_cache_server=use_cache_server, verify_ssl=verify_ssl)
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\venv\lib\site-packages\fake_useragent\utils.py", line 245, in update
write(path, load(use_cache_server=use_cache_server, verify_ssl=verify_ssl))
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\venv\lib\site-packages\fake_useragent\utils.py", line 178, in load
raise exc
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\venv\lib\site-packages\fake_useragent\utils.py", line 154, in load
for item in get_browsers(verify_ssl=verify_ssl):
File "C:\E\ZJD\数据爬取工具\getshaper\getShp-master\venv\lib\site-packages\fake_useragent\utils.py", line 99, in get_browsers
html = html.split('