š Hi, Iām Julien Buonarota
I am interested in Data science and open source code. As such I am a happy user of Emacs and mostly code in python, SQL, R, bash and a bit of elisp.
- Climbing data analysis Project where I collected data from the website Social Boulder to analyze the behaviour the climbing gym customers. I used python and Postgresql.
- The regular web scraping is done with the Social boulder gym scrapper script which call the boulder scraper function which gather all the http informations concerning the boulders currently set in a gym. Each boulder's http information is then parsed with the boulder parser function.
- All the informations gathered with the python web scraper are stored in a Postresql database with this database tools written in python. The database itself was created with this python script.
- Process Logger: Simple to use bash script ProcessLogger allow to keep a log of process, keeping track of their execution. It allows to ask the question:
As this process been executed in the last minute/hour/day...
All the code is in one bash file and can be used with this python API.