This web crawler watches different pages of my university net and sends notifications to a telegram channel.
- Sending documents which the professors uploaded to the MyStudy web page
- Sending a notification if the state of an exam has changed on the exam server
- Sending schedule if a new version is online
This crawler was created for the RheinAhrCampus of the Hochschule Koblenz and only tested there. Maybe parts work at other German universities with similar portals, but I don't know.
- Download this script
git clone htps://github.com/Andre0512/StudyCrawler.git && cd MyStudyCrawler
- Create a virtual environment (optional)
python3 -m venv ./venv && source ./venv/bin/activate
- Install requirements
pip install -r requirements.txt
- Add your personal data to
secrets.py
mv secrets.py.default secrets.py && vim secrets.py
This can be a bit tricky, contact me if you have any questions. - Create entry in
/etc/crontab
to execute this script e.g. every three minutes
echo "*/3 * * * * $USER $PWD/venv/bin/python $PWD/crawler.py" | sudo tee --append /etc/crontab
This project is under MIT-License. Have fun :)