This project focuses on analyzing Uber trip data using Python. The dataset is processed and transformed into a structured format suitable for analysis and visualization.
The data pipeline involves several steps:
- Data loading from an external API.
- Transformation of raw data into structured formats.
- Exporting the transformed data to a BigQuery warehouse.
- Uber Data Pipeline.ipynb: Jupyter Notebook containing the code for data processing and transformation.
- extract.py: Python script for loading data from an API.
- load.py: Python script for exporting data to BigQuery.
- transform.py: Python script for transforming raw data into structured formats.
To replicate the analysis:
- Clone the repository.
- Run the Jupyter Notebook
Uber Data Pipeline.ipynb
. - Ensure required Python packages are installed.
- Python
- Pandas
- Requests
- BigQuery