Giter VIP home page Giter VIP logo

megrez21's Projects

captcha_server icon captcha_server

一个免费开源一键搭建的通用验证码识别平台，大部分常见的中英数验证码识别都没啥问题。

cookiepool icon cookiepool

一个强大的Cookie池项目，融合scrapy/requests/chrome储存cookie/cookie字符串/selenium等cookie形式

distribute_crawler icon distribute_crawler

使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现

findtrip icon findtrip

机票爬虫（去哪儿和携程网）。flight tickets multiple webspider.(scrapy + selenium + phantomjs + mongodb)

lxspider icon lxspider

爬虫案例合集。包括但不限于《淘宝、京东、天猫、豆瓣、抖音、快手、微博、微信、阿里、头条、pdd、优酷、爱奇艺、携程、12306、58、搜狐、各种指数、维普万方、Zlibraty、Oalib、小说、招标网、采购网、小红书、大众点评、推特、脉脉》

mooc_downloader icon mooc_downloader

学无止下载器，慕课下载器，Mooc下载，慕课网下载，**大学下载，爱课程下载，网易云课堂下载，学堂在线下载，超星学习通下载；支持视频，课件同时下载

music-163 icon music-163

爬取网易云音乐所有歌曲的评论数

proxypool icon proxypool

An Efficient ProxyPool with Getter, Tester and Server

python_antispider icon python_antispider

基于Python3实现的js加密反爬，验证码破解，字体加密反爬等其他类型反爬虫的破解

qqspider icon qqspider

QQ空间爬虫（日志、说说、个人信息）

spider icon spider

python爬虫 全球网址URL滚动提取

stockholm icon stockholm

一个股票数据（沪深）爬虫和选股策略测试框架

vvtoolbox-gui-series icon vvtoolbox-gui-series

本软件是一款用于m3u8下载（支持AES解密、优酷普通DRM解密）、视频解析（后续增加）的工具，同时集成部分有关于vvtoolbox相关的功能，如下载视频弹幕（后续...）等。

wechatsogou icon wechatsogou

基于搜狗微信搜索的微信公众号爬虫接口

wooyun_public icon wooyun_public

This repo is archived. Thanks for wooyun! 乌云公开漏洞、知识库爬虫和搜索 crawl and search for wooyun.org public bug(vulnerability) and drops

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.