lapolis / lazyosint Goto Github PK

Hi, me again! Still love this. Not sure what has happened, but I can't seem to get it to run at all now, either on a new system or an existing installation. I get the following error:
Traceback (most recent call last):
File "./main.py", line 169, in
main()
File "./main.py", line 162, in main
lin = [ x.result() for x in concurrent.futures.as_completed( linkedinT ) ]
File "./main.py", line 162, in
lin = [ x.result() for x in concurrent.futures.as_completed( linkedinT ) ]
File "/usr/lib/python3.8/concurrent/futures/_base.py", line 432, in result
return self.__get_result()
File "/usr/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
raise self._exception
File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/user/LazyOSINT/lib/linkedinCompanyScraper.py", line 185, in scrapeThoseEmployeez
self.login( email , password )
File "/home/user/LazyOSINT/lib/linkedinCompanyScraper.py", line 81, in login
element = WebDriverWait(self.driver, 10).until(EC.presence_of_element_located((By.ID, "profile-nav-item")))
File "/home/user/.local/lib/python3.8/site-packages/selenium/webdriver/support/wait.py", line 80, in until
raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:

I've tried updating everything, removing all the requirements using pip and then reinstalling. I am sure its a requirement version wrong, but can't seem to identify which one.

Love this tool!

occasionally I hit the google search captcha, rather than carrying on and erroring on google look ups, the script could pause at this point to either manually correct the captcha or change IPs and then resume.

Or even have a resume function built in to the tool so one can cancel it and then resume again at a later time

Hi again,
I have ran in to another issue, it looks like Selenium is struggling with the headless Chrome installed. I have updated recently and so it could be that its running in to a feature that has been removed:
Traceback (most recent call last):
File "/home/osint/LazyOSINT/./main.py", line 169, in
main()
File "/home/osint/LazyOSINT/./main.py", line 162, in main
lin = [ x.result() for x in concurrent.futures.as_completed( linkedinT ) ]
File "/home/osint/LazyOSINT/./main.py", line 162, in
lin = [ x.result() for x in concurrent.futures.as_completed( linkedinT ) ]
File "/usr/lib/python3.9/concurrent/futures/_base.py", line 433, in result
return self.__get_result()
File "/usr/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
raise self._exception
File "/usr/lib/python3.9/concurrent/futures/thread.py", line 52, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/osint/LazyOSINT/lib/linkedinCompanyScraper.py", line 207, in scrapeThoseEmployeez
self.driver.find_element_by_xpath( see_employees_xpath ).click()
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 394, in find_element_by_xpath
return self.find_element(by=By.XPATH, value=xpath)
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 976, in find_element
return self.execute(Command.FIND_ELEMENT, {
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
self.error_handler.check_response(response)
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"xpath","selector":"//div[@Class="mt2"]"}
(Session info: headless chrome=88.0.4324.182)