hayj Goto Github PK

scroller

This tools can simulate human scrolling using randomize mechanism. It take a Selenium driver and scroll the current page. You can give a stop funct callback which is called at regular intervals and have to return True to terminate the scroll, you can set the speed, set a timeout...

shutdowntimer

A UI tool to shutdown / snooze Microsoft Windows shutdown

sparktools

This package gather useful tools for spark programming

st4

ST4 pour CentraleSupelec

stanford-corenlp-python

Python wrapper for Stanford CoreNLP tools v3.4.1

stsexercise

stsseries

This project experiment doc2vec vectors combinason method on the STS 2016 dataset

systemtools

This project gathers useful Python functions and classes organized in different modules.

tutorials

twinews

A news and Twitter users dataset for the news recommendation task

unshortener

This tool unshort urls from bit.ly, tinyurl.com or a lot of other url shorterner services. It cache all urls you request in a mongo database (or in a pickle file) so the request will be sent one time for each url. The cache is limited so the database will growth with a limit, only old items are removed (in term of get and write)

webbrowser

This tool is a wrapper over selenium and requests. It allow an easy use of phantomjs and Chrome (headless or not) through Selenium. It handle selenium instability by killing dead process. You can set proxy and it will automatically applied it (through plugin with Chrome to handle user/password...). It use DomainDuplicate lib to control pages content. Each requests return normalized content over all drivers. It will randomly select a header (and seed it by proxy ip).

webcrawler

The WebCrawler class exploit the WebBrowser lib (which use Selenium and requests) to crawl URLs in parallel. This lib is "callback oriented".

webview2img

A tool that seamlessly generate a PNG from an Android WebView.

workspacemanager

This tool can manage a workspace by providing some useful functions (generation of the setup file and others, generate a virtual env according to the project name, install your own dependencies, generate dist of all dependencies...). See the readme for more informations.