An example which executes a Celery task using Celery Groups and Celery chunks and monitors memory usage

You can change number of tasks, chunk size and loop limit in constants.py

brew install redis

brew upgrade redis

sudo apt-get install redis-server

sudo service redis-server start

virtualenv env

source env/bin/activate

pip install -r requirements.txt

RUN file run_celery.py or command -> celery -A tasks worker -n chords --loglevel=info

python monitor_usage.py

RUN file run_flower.py or command celery -A tasks flower --port=5511 --loglevel=info