soclosesociety / bot-doctorlib_scrapping Goto Github PK

Your machine must be installed with python. To check, go to CMD and type -> py.
It will show the Installed python version if python is already installed on your machine.
If not, go to - https://www.python.org/

• Nord VPN is required
• Your machine need to able connect with nord through command line.
• To to this add nord vpn path to your environment variable path. Usually nord vpn path is - C:\Program Files\NordVPN\

Checking if we are able to connect NordVPN through commandline

nordvpn -c

Success!!!

For more information you can read - https://support.nordvpn.com/Connectivity/Windows/1350897482/Connect-to-NordVPN-app-on-Windows-using-the-Command-Prompt.htm

Steps -

1. Run requirements.txt from cmd. Type this command in your project terminal -> pip install -r requirements.txt
2. Enter specialization and Place. It will ask in console.
3. Run main.py

This program will generate 2 csv files. At first, it will go through search query and will collect profile links. It will clean & dump those links on 'doctolib_profile_link.csv'

After that it will automatically go to each profile link & scrap data. It will save those data at 'doctolib_profile_details.csv' file.