Giter VIP home page Giter VIP logo

snapcrawler's Introduction

snapcrawler

Snapcrawler is a web scrapper tool used to scrape entire images from any web site of your choice. This tool was built using nodejs and puppeteer

pic

Instructions for running:

  • npm install snapcrawler
  • npx snapcrawler

requiments

  • Node JS
  • Edge browser
To update the package
  • npm update snapcrawler

    • Test case: Images stored inside html img tag works , but images stored inside external servers such as CDN or aws S3 cannot be retrieved

    Note:- The saved images can be found in the c drive downloads folder and inside that a folder will be automatically be created and images will be stored

    snapcrawler's People

    Contributors

    prethammuthappa avatar

    Stargazers

    avatar avatar avatar avatar avatar avatar avatar avatar

    Watchers

    avatar

    Recommend Projects

    • React photo React

      A declarative, efficient, and flexible JavaScript library for building user interfaces.

    • Vue.js photo Vue.js

      🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

    • Typescript photo Typescript

      TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

    • TensorFlow photo TensorFlow

      An Open Source Machine Learning Framework for Everyone

    • Django photo Django

      The Web framework for perfectionists with deadlines.

    • D3 photo D3

      Bring data to life with SVG, Canvas and HTML. 📊📈🎉

    Recommend Topics

    • javascript

      JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

    • web

      Some thing interesting about web. New door for the world.

    • server

      A server is a program made to process requests and deliver data to clients.

    • Machine learning

      Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

    • Game

      Some thing interesting about game, make everyone happy.

    Recommend Org

    • Facebook photo Facebook

      We are working to build community through open source technology. NB: members must have two-factor auth.

    • Microsoft photo Microsoft

      Open source projects and samples from Microsoft.

    • Google photo Google

      Google ❤️ Open Source for everyone.

    • D3 photo D3

      Data-Driven Documents codes.