katoni / crawler Goto Github PK
View Code? Open in Web Editor NEWThis project forked from thingston/crawler
Web crawler based on PHP [Guzzle HTTP Client](http://docs.guzzlephp.org/) with concurrency support for faster operation. Includes support for any content-type download, link profiler and response observers.