This code will download ODI data from the website, pre-process it using spark and finally transfer to MySQL DB for analysis
- MySQL, Java & Python shouldโve been installed. I cannot provide code for that since the process is different for different OS
JAVA_HOME
variable should be set
Before running ensure that the MYSQL_PASSWORD
variable is set to your root password in the .env
file.
Open the folder on the terminal and run the following
pip install -r requirements.txt && python main.py