Giter VIP home page Giter VIP logo

linvo-scraper's Introduction

logo

Welcome to Linvo Linkedin Scraper

License: MIT License

Here you can find secure scraping using Puppeteer for different Linkedin actions

  • Login
  • Scrape profiles: Sales Nav / Normal
  • Connection Request
  • Follow message
  • Endorse Profile
  • Visit Profile
  • Like posts
  • Random Engagement

Install

npm install linvo-scraper puppeteer --save

Usage

import * as LinvoScraper from 'linvo-scraper';
import * as puppeteer from 'puppeteer';

(async () => {
    const browser = await puppeteer.launch({
        headless: false
    });
    const page = (await browser.newPage());
    const cdp = await page.target().createCDPSession();

    // that's the res Linvo is working in production
    await page.setViewport({
        width: 1440,
        height: 900,
    });

    // add ghost-cursor for maximum safety
    await LinvoScraper.tools.loadCursor(page, true);

    // Login with Linkedin
    const {token} = await LinvoScraper.services.login.process(page, cdp, {
        user: '[email protected]',
        password: 'superStrongPass!!%'
    })

    // set cookies
    await page.setCookie({
        name: "li_at",
        value: token,
        httpOnly: true,
        secure: true,
        sameSite: "None",
        priority: "Medium",
        path: "/",
        domain: ".www.linkedin.com",
    });

    await LinvoScraper.services.connect.process(page, cdp, {
        message: 'Hi Nevo! Let\'s connect!',
        url: 'https://www.linkedin.com/in/nevo-david/'
    })
})();

Who made this project

This project was made by Linvo - The Safest Linkedin Automation Tool, and being maintained by Nevo David Any contribution is welcomed!

๐Ÿค Contributing

Please check our Contribution guide to get started!

Contributions, issues and feature requests are welcome!
Feel free to check issues page.

  • Fork the repository, Clone it on your device. That's it ๐ŸŽ‰
  • Finally make a pull request :)

๐Ÿ“ License

This project is MIT License licensed.


We accept contribution with great love! Show your interest! Contribute!

How to get GitHub stars

linvo-scraper's People

Contributors

arjun31415 avatar codingis4noobs2 avatar emalton avatar kailashchoudhary11 avatar nevo-david avatar shashankbhatgs avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

linvo-scraper's Issues

Hacktoberfest issues

Hi, just stumbled into this repo from reddit and noticed it was tagged with the hacktoberfest tag. I saw there's an issue to add a contributing template. Is there any low-hanging fruit or feature requests that you might want people to contribute towards? I'm interesting in lending a hand.

I can't use search filter from Linvo-scraper

Description

I'm not able to use the LinvoScraper.services.scraper.process() because a url generated from functions it's invalid. The result shows an invalid url.

Screenshots

image

Additional information

I openned a pull request solving the problema.

Send a message without connect

There is a trick to sending a message without a connect message.
You go to group members:
https://www.linkedin.com/groups/6519652/members/

You will find out a "message" button.
If you click on the button, it will write a message to that persona without connecting.

We need to create a process that gets the group id, prospect name, and message searches for that prospect name in the group and sends a message.

[DOCS] Add URL examples for scraping services

Description

I have been trying to use Linvo's scraping library found in the linkedin.global.page.service.ts . Unfortunately, in the required parameters section it doesn't specify which URLs are acceptable for scraping.

interface RequiredData {
  page: number;
  url: string; //WHAT DOES THE URL LOOK LIKE
  remove_overlapping: boolean;
}

It would be very helpful to provide one or more of the following:

  • TypeScript URL checking
  • A descriptive URL related comment in the linkedin.global.page.service.ts file
  • A descriptive error message that outlines which webpages are appropriate
  • Documentation that specifies which webpages can be scraped

Right now, when I provide the following URL as an argument

https://www.linkedin.com/search/results/all/?keywords=DATA%20SCIENCE%20JOBS&origin=GLOBAL_SEARCH_HEADER&sid=Q~M

I receive the warning:

originalMessage: 'Cannot navigate to invalid URL'

Unfortunately, for less experienced users like myself, this error message is not informative enough to be actionable.

Scrape comments

Scrape people comments
Please keep the same format like the global scraper

[OTHER] Sponsorship

What would you like to share?

Hi love your repo and product. Would like to explore possible collaboration. Please get in touch.

Additional information

No response

[DOCS] <description>

Description

Add README.md file.

Screenshots

No response

Additional information

No response

Readme.md example code triggers error

System Information:

  • OS: Windows 11 Home
  • Processor: x64-based processor
  • Node version: v16.15.1

Issue

In the Readme.md, there is the following code:

import * as LinvoScraper from 'linvo-scraper';
import * as puppeteer from 'puppeteer';

(async () => {
    const browser = await puppeteer.launch({
        headless: false
    });
    const page = (await browser.newPage());
    const cdp = await page.target().createCDPSession();

    // that's the res Linvo is working in production
    await page.setViewport({
        width: 1440,
        height: 900,
    });

    // add ghost-cursor for maximum safety
    await LinvoScraper.tools.loadCursor(page, true);

    // Login with Linkedin
    const {token} = await LinvoScraper.services.login.process(page, cdp, {
        user: '[email protected]',
        password: 'superStrongPass!!%'
    })

    // set cookies
    await page.setCookie({
        name: "li_at",
        value: token,
        httpOnly: true,
        secure: true,
        sameSite: "None",
        priority: "Medium",
        path: "/",
        domain: ".www.linkedin.com",
    });
   //BELOW FUNCTION TRIGGERS ERROR
    await LinvoScraper.services.connect.process(page, cdp, {
        message: 'Hi Nevo! Let\'s connect!',
        url: 'https://www.linkedin.com/in/nevo-david/'
    })
})();

Code block that triggers error (line 38):

   //BELOW FUNCTION TRIGGERS ERROR
    await LinvoScraper.services.connect.process(page, cdp, {
        message: 'Hi Nevo! Let\'s connect!',
        url: 'https://www.linkedin.com/in/nevo-david/'
    })

Error Message

const gotSelector = "[Got Selector]".cyan() + " " + selector.blue();
TypeError: "[Got Selector]".cyan is not a function

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.