yyy1000 / openhouse Goto Github PK

OpenHouse is an open source control plane designed for efficient management of tables within open data lakehouse deployments. The control plane comprises a declarative catalog and a suite of data services. Users can seamlessly define Tables, their schemas, and associated metadata declaratively within the catalog. OpenHouse reconciles the observed state of Tables with the desired state by orchestrating various data services.

For building and running locally in Docker Compose, you would need the following:

• Java
  • OpenHouse is currently built with Java 8, and will be modernized soon.
  • Set the JAVA_HOME environment variable to the location of your JDK8.
• Docker
• Docker Compose
• Python3

For deploying OpenHouse to Kubernetes, you would need the following:

• Helm
• Kubernetes

To build OpenHouse, you can use the following command:

./gradlew build

To run OpenHouse, we recommend the SETUP guide. You would bring up all the OpenHouse services, MySQL, Prometheus, Apache Spark and HDFS.

To deploy OpenHouse to Kubernetes, you can use the DEPLOY guide. You would build the container images for all the OpenHouse services, and deploy them to a Kubernetes cluster using Helm.

OpenHouse is built with the following versions of the open-source projects:

We welcome contributions to OpenHouse. To get involved:

• Join OpenHouse Slack
• Open Github Issue for the feature or bug you want to collaborate on

Please refer to the CONTRIBUTING guide for more details. To get started on the high-level architecture, please refer to the ARCHITECTURE guide.