docker_data_science_stack's Introduction

Docker_Data_Science_Stack

A Docker Data Science Workflow Stack

Note : Must Have Docker Installed for Linux , and Docker Desktop for MacOS/Windows

Defaults

By default the password and secret keys are set to : docker321 and user is admin.

How to Run

Clone this repository onto your machine .
Using commandprompt/terminal navigate to the downloaded repo.
Run the command : docker-compose build apistar to build the APIStar Image.
After the above , run the command : docker-compose up , alternatively you can use docker-compose -d up to run in background.

What Services You will Have :

Jupyter for Data Manipulation and Exploration.
SuperSet for Data Visualisation.
Minio for Non-Relational Object Data Storage , which is also Amazon S3 compatible.
PostgreSQL for Database , with persistent storage.
APIStar for api related queries.
Airflow for Task Scheduling.
Portriner for administring docker images on ports.
PgAdmin4 for Visualising and interacting with PostgreSQL.

Service - Port Mappings

Service	Port
Airflow	8080
Apistar	8000
Jupyter	8888
Minio	9000
Portainer	9090
Postgres	5432
Superset	8088
PgAdmin4	5050

Additonal Instructions for PgAdmin4

goto localhost:5050.
Enter email : [email protected] , password : docker321.
Create new Server > On the first tab add suitable name > goto connections tab and enter data : * Host : your machine IP Address * Port : 5432 * Maintenence : postgres * Username : postgres * password : docker321
Click save , now you can see databased under servers tab.

docker_data_science_stack's People

Contributors

Stargazers

Watchers

docker_data_science_stack's Issues

Problem: User Superset

Hey. I would like to check your project out myself. By following your guide i encountered some problems.

021-01-03 14:41:41.262 UTC [113] FATAL:  password authentication failed for user "superset"
postgres_1   | 2021-01-03 14:41:41.262 UTC [113] DETAIL:  Role "superset" does not exist.
postgres_1   |  Connection matched pg_hba.conf line 99: "host all all all md5"

There is a problem with superset. It havent created something it needs to and so a lot of following problems occured and now I think I'm stuck in a boot loop of the docker-compose command.

Is there anything to consider to use the superset? I'm using windows and it's maybe a command that is not supported there?

Recommend Projects