parser_maps's Introduction

parser_maps

Parsing Yandex Maps 'https://yandex.ru/maps'

Simple start

change type_org_mapping from constants.py, (type_org_mapping = 'folder name': 'query' For example, type_org_mapping = 'showroom': 'Шоу-рум')

pip3 install -r requirements.txt
python3 link_parser.py showroom
python3 info_parser.py showroom

1. link_parser.py

creating selenium webdriver.
creating LinksCollector object.
run collecting links with params of city, district, organization type and folder name for saving results.

driver = webdriver.Safari()
grabber = LinksCollector(driver)
grabber.run(city='Москва', district='район Арбат', type_org_ru='Кафе', type_org='cafe')

2. info_parser.py

creating selenium webdriver.
creating Parser object.
parse data with params of hrefs list, folder name of links from prev step

driver = webdriver.Safari()
parser = Parser(driver)
parser.parse_data(all_hrefs, type_org)

parser_maps's People

Contributors

Stargazers

Watchers

parser_maps's Issues

Ошибка при запуске

Добрый день! Пытаюсь запустить ваш код, выдаёт ошибку:

DevTools listening on ws://127.0.0.1:64188/devtools/browser/cec4fc34-7726-4347-965c-9d3caeee283c
Traceback (most recent call last):
  File "D:\parser\parser_maps\link_parser.py", line 107, in <module>
    grabber.run(city="Санкт-Петербург", district=district, type_org_ru=type_org_mapping[type_org], type_org=type_org)
  File "D:\parser\parser_maps\link_parser.py", line 63, in run
    self._open_page(request)
  File "D:\parser\parser_maps\link_parser.py", line 35, in _open_page
    self.driver.find_element_by_class_name(name='search-form-view__input').send_keys(request)
  File "D:\parser\parser_maps\venv\lib\site-packages\selenium\webdriver\remote\webelement.py", line 477, in send_keys
    self._execute(Command.SEND_KEYS_TO_ELEMENT,
  File "D:\parser\parser_maps\venv\lib\site-packages\selenium\webdriver\remote\webelement.py", line 633, in _execute
    return self._parent.execute(command, params)
  File "D:\parser\parser_maps\venv\lib\site-packages\selenium\webdriver\remote\webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "D:\parser\parser_maps\venv\lib\site-packages\selenium\webdriver\remote\errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.ElementNotInteractableException: Message: element not interactable
  (Session info: chrome=127.0.6533.74)