crawler-engine with HTTP, proxy, JS-Java Interoperability, MQ task consumption, dynamic crawler scripts execution. support deployment in distribution style.
crawler-engine with HTTP, proxy, JS-Java Interoperability, MQ task consumption, dynamic crawler scripts execution. support deployment in distribution style.
REQUIREMENTS
JDK 8 (note: if require Nashorn feature ClassFilter, then 1.8u45+ is mandatory);