- Run mongo with following command
docker-compose -f infrastructure/docker-compose.yml up -d
# check if mongo start corectly
docker ps
If you want to stop container run following command
docker-compose -f infrastructure/docker-compose
- To turn on the receiver (RabbitMQ server), use the following command:
python services/scrapper/receive.py
When enabled, the receiver will be able to receive messages sent by the crawler.
- To start the crawler with sending messages to the receiver use the following command:
python services/main.py
Data is currently being sent to the database.
Run test.py file in services/scrapper