- Link here
- Monitoring tool here
Before proceeding make sure you have started zookeeper and kafka, also make sure you have created necessary topics (follow the scrips folder here )
To run the kafka producer use this file
To run the kafka consumer use this file
If using ElasticSearch with bonsai make sure to set an appropriate number of requests:
PUT twitter/_settings
{
"index.mapping.total_fields.limit": 5000
}