View Code? Open in Web Editor
NEW
NodeJS Schedule Scraper Project for Upwork
schedule-scraper's Introduction
NodeJS Schedule Scraper Project for Upwork
- Clone the repo
- Open up a terminal in the same directory
- run npm install to install packages
- node main.js {Event Day} to run the scraper
- After a successful execution 'data.json' file should be outputted in same directory
- Also the script uses p-Limit package to restrict the number of concurrent promises to 30
- This can be changed by changing the line
const limit = pLimit(30);
-- > const limit = pLimit({new limit});
- Cheerio
- Puppeteer
- Request-Promise
- pLimit
schedule-scraper's People
Contributors
Watchers