crawler for twitter (without using api)

jre8u161
global proxy to crawl twitter

use the prodived jar file to crawl twitter
infoCrawler.jar is used to crawl user meta information, following and followers' screen name
tweetsCrawler.jar is used to crawl user's tweets(include retwees, some video tweets may be lost, maintaining)
collect information from file:
java -jar infoCrawler.jar
java -jar tweetsCrawler.jar
collect information from args
java -jar infoCrawler.jar Glen_Sjh
java -jar tweetsCrawler.jar Glen_Sjh

file personToCrawl.txt is used to specify users to crawl (SCREEN NAME should be used) also, global proxy should be added to crawl twitter

The output of the program will be a folder named "Twitter", all user infomation are stored in sub folder named by screen name.

We seperate the program into two jars to increase the speed, due to crawler limitation, it costs much time to crawl user's all followers(about 20min for 20000 followers). The speeds to crawl user's tweets is about 15min for 20000 tweets.
Make sure you delete all contents in Twitter/ before you run new program (re-run the program will cause repeatition issue)