hayj Goto Github PK

404detector

This tool recognize 404 error according to the html content

annotator

This tool allow users to labelize data one by one with a tkinter UI. You just need to give a set of label type and a set of data to be labelized. All labels will be stored either in a pickle file or a mongo collection.

asautils

authfilt

This repository gather functions and classes allowing to apply a highly scalable and efficient author filtering process on any corpus.

bash

Some useful bash functions

basics

Library of Java tools including basics

cstwitteranalysis

Student projet at CentraleSupélec

databasetools

The class MongoCollection allow an easy config of a MongoDB collection by providing an interface which handle authentication, indexes management, data conversion and pretty print of collections. It can work like a Python dict if you give at least one index.

datastructure

Some usefull data structures

datastructuretools

This repository provide some useful Python data structures, especially SerializableDict

datatools

This project gathers useful modules on url parsing, csv reading, html parsing etc.

dataviztools

Python utils for data visualization (bokeh, pandas...)

deepstyle

DeepStyle provides pretrained models aiming to project text in a stylometric space. The base project consists in a new method of representation learning and a definition of writing style based on distributional properties. This repository contains datasets, pretrained models and other ressources that were used to train and test models.

domainduplicate

This tool detect duplicates over web pages of a domain to control crawling process. It prevent the crawl of captcha pages or "refuse" page for example.

fakebackendtest

honeypotdetector

This tool can recognize honeypot urls using selenium to prevent bot detection

hyperopt

Distributed Asynchronous Hyperparameter Optimization in Python

hyperopt-sklearn

Hyper-parameter optimization for sklearn

lbpextract

Un outil permettant de convertir les relevés de compte PDF de La Banque Postale en fichier CSV lisibles dans un tableur.

ma-fsa

This is a minimal acyclic finite-state automata algorithm in Java based on the paper, "Incremental Construction of Minimal Acyclic Finite-State Automata".

machinelearning

Provide some useful tools for machine learning

markdown2html

Convert a mardown file to a html file with a given css style (or a default one)

monolingual-word-aligner

moodle-mod_elang

A moodle module for learning language

newssourceaggregator

newstools

This tool is useful to detect news URLs. It also aggregates several libraries which scrap news web pages (title, content...).

nlptools

Provide useful NLP tools to get word embeddings, preprocess text data...

py4j

Py4J enables Python programs to dynamically access arbitrary Java objects

rapport_lri

renewalsimulator

This repository allows to simulate a Renewal competition