federicohaag / linkedinscraping Goto Github PK

configparser.NoSectionError: No section: 'profiles_data'

When a job is divided into multiple functions like on the screenshot above it is not recognized by the script.

Hi
I am Rizwan, I am working on a bot that can be used for marketing.
Phases include
1.Scraping emails of persons with specific Hashtags on their post
2.Perform automation to send emails in bulk to those people
I am working on the ist part I want to start working right aways making additions in your code.
I have tried to reach out you on LinkedIn kindly look into that please

This code is no longer able get names of the person's from their LinkedIn profile. Also LinkedIn added "Remember me on browser" screen and after that the code fails.

Please add new code to address these issues.

Hello,

is it possible to update the version please? It doesn't work well...

Thanks

[WDM] - Current google-chrome version is 85.0.4183
[WDM] - Get LATEST driver version for 85.0.4183
[WDM] - Driver [/Users/.../.wdm/drivers/chromedriver/mac64/85.0.4183.87/chromedriver] found in cache
Scraping Ended

Hello, if a person has had more than one role or position within the same company, the script fails. Any idea how to add this functionality? Thank you

Hi! Im trying to scrape multiple person data in a for loop but even closing the driver, this library mix the data in the fields. Any suggestion?

Code Implemented:

from linkedin_scraper import Person, Company, actions
from selenium import webdriver
Personas = []

for i in range(5):
driver2 = webdriver.Chrome()
email = "[email protected]"
password = "Angostura!2020"
actions.login(driver2, email, password) # if email and password isnt given, it'll prompt in terminal
p= Personas.append(Person(str(final_test_short[i]).replace('['',"").replace('']',""), scrape=True,driver=driver2))
del driver2
sleep(2)

Hi Federico, thanks for this super useful tool! I completed the configuration and came to this point:

Configuration completed. You can now do scraping.
To scrape profile by url: execute do_scraping.py
To search profiles by name: execute search_profiles_by_name.py

I'm interested in collecting data from a list of names, but it doesn't look like there is an option to do it by name yet? (As an aside, it'd be awesome if you could also restrict it to geographic area, in case of duplicate names.)

I was just look at this repo to use it for an upcoming project and was about to extend it to find phone numbers. Before that, I noticed that the current way to scrape an email and similar is relatively verbose. Is there any interest in updating to querySelector?

As an example, that'd change this:

email = self.browser.execute_script(
     "return (function(){try{for (i in document.getElementsByClassName('pv-contact-info__contact-type')){ "
                "let el = document.getElementsByClassName('pv-contact-info__contact-type')[i]; if("
                "el.className.includes( 'ci-email')){ return el.children[2].children[0].innerText; } }} catch(e){"
                "return '';}})()")

to this:

email = self.browser.execute_script(
                "return (function(){try{return document.querySelector('.pv-contact-info__contact-type.ci-email a')"
                ".innerText;} catch(e){return '';}})()")

Which I think is likely to be more readable long term?

Happy to take it on if there's interest in that, as well as adding some extra methods on Scraper for other information available in the Contact Info tab.

Hi. I was giving it a try for an OSINT project, and I get this:

selenium.common.exceptions.SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 80

My current chrome version is 83.0.4103.106

Thanks for sharing anyway.