melcutz Goto Github PK

adblockparser

Python parser for Adblock Plus filters

aduana

Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even when making big crawls (one billion pages).

autopager

Detect and classify pagination links

covid19study

Simulation of measures to prevent spread of Covid19

datasketch

MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++

deeplearn

Implementation of research papers on Deep Learning+ NLP+ CV in Python using Keras, Tensorflow and Scikit Learn.

eli5

A library for debugging/inspecting machine learning classifiers and explaining their predictions

extruct

Extract embedded metadata from HTML markup

flatson

Tool to flatten stream of JSON-like objects, configured via schema

formasaurus

Formasaurus tells you the type of an HTML form and its fields using machine learning

frontera

A scalable frontier for web crawlers

fuzzyset

A simple fuzzy matching set for python strings

ga-beacon

Google Analytics collector-as-a-service (using GA measurement protocol).

gcloud-python

Google Cloud Client Library for Python

hunting_criminals_demo

Free Notebooks and code

imagesimilarity

Given a new image, determine if it is likely derived from a known image.

langid.py

Stand-alone language identification system

mcmc-randomwalk

Simple MCMC

mdr

A python library detect and extract listing data from HTML page.

models

Models built with TensorFlow

mrjob

Run MapReduce jobs on Hadoop or Amazon Web Services

mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

negex

Automatically exported from code.google.com/p/negex

nlp-demo-2017

Semantic natural language understanding at scale using Spark, machine-learned annotators and deep-learned ontologies

nlp_demo

nlu_tutorial

page_clustering

A simple algorithm for clustering web pages, suitable for crawlers

pandasql

sqldf for pandas

portia

Visual scraping for Scrapy

psquery

Predictive Services query client