Giter VIP home page Giter VIP logo

helm.astronomer.io's Introduction

Astronomer Platform Helm Charts

This repository contains the helm charts for deploying the Astronomer Platform into a Kubernetes cluster.

Astronomer is a commercial "Airflow as a Service" platform that runs on Kubernetes. Source code is made available for the benefit of our customers, if you'd like to use the platform reach out for a license or try out Astronomer Cloud.

Architecture

Astronomer Architecture

Docker images

Docker images for deploying and running Astronomer are currently available on DockerHub.

Documentation

The Astronomer Platform documentation is located at https://www.astronomer.io/docs/

Contributing

We welcome any contributions:

  • Report all enhancements, bugs, and tasks as GitHub issues
  • Provide fixes or enhancements by opening pull requests in Github

Local Development

Install the following tools:

  • docker (make sure your user has permissions - try 'docker ps')
  • kubectl
  • kind
  • gcloud cli (make sure gsutil in PATH)
  • helm

Make sure you have access to the GCP development account

# Check that you can download the development TLS cert:
gsutil cat gs://astronomer-development-certificates/fullchain.pem

If this does not work, anyone with 'Owner' in the development project can grant you 'Owner' via IAM.

Run this script from the root of this repository:

bin/reset-local-dev

Each time you run the script, the platform will be fully reset to the current helm chart.

Customizing the local deployment

Turn on or off parts of the platform

Modify the "tags:" in configs/local-dev.yaml

  • platform: core Astronomer components
  • logging (large impact on RAM use): ElasticSearch, Kibana, Fluentd (aka 'EFK' stack)
  • monitoring: Prometheus
  • kubed: leave on

Swap a component with a local image

  • Build new image locally
docker build -t my-custom-image:unique-tag ./my-image-dir
kind load docker-image my-custom-image:unique-tag
  • List deployments
kubectl get deployments -n astronomer
  • Edit the deployment
kubectl edit deployment -n astronomer <deployment name>
  • Search for "image" and replace the appropriate image with the local image name.

Releasing

Releasing Guide

License

Usage of Astronomer code requires an Astronomer Platform Enterprise Edition license.

helm.astronomer.io's People

Contributors

schnie avatar tedmiston avatar cwurtz avatar andscoop avatar sjmiller609 avatar ianstanton avatar ashb avatar kaxil avatar andriisoldatenko avatar ryw avatar vepetkov avatar bonominijl avatar petedejoy avatar rhwang10 avatar virajmparekh avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.