Giter VIP home page Giter VIP logo

positionanalysis's Introduction

介绍

这是一个node爬虫程序, 用来爬取拉勾网的职位信息

usage

  • $ git clone https://github.com/zsqosos/positionAnalysis.git
  • $ npm install
  • $ cd carwler切换到当前目录
  • $ node index city position传入要爬取的城市和职位信息

说明

  • 爬取的数据都会以.json储存在data目录下
  • 程序使用了superagent async 类库

LICENSE

MIT

positionanalysis's People

Contributors

zsqosos avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

positionanalysis's Issues

招聘详情抓取

我想请教怎么抓取招聘的详情,我直接在拉钩上现在找不到请求

拉勾的反爬虫怎么解决?

在请求到第十页之后,会出现错误,后面的文件都会成为下面的错误

{"success":false,"msg":"您操作太频繁,请稍后再访问","clientIp":"1.2.3.4"}

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.