Giter VIP home page Giter VIP logo

bbr-pcf-pipeline-tasks's Introduction

BBR PCF Pipeline Tasks

This is a collection of Concourse tasks for backing up a Pivotal Cloud Foundry installation using bbr.

Running regular backups (at least every 24 hours) and storing multiple copies of backup artifacts in different datacenters is highly recommended. The time Concourse resource can be added to the pipeline to trigger backups regularly. There are a variety of storage resources such as S3 that can be used to move backups to storage. A list of Concourse resources can be found here.

Tasks

export-om-installation

Inputs

  • bbr-pipeline-tasks-repo: this repository

Outputs

  • om-installation: a directory containing a installation.zip generated by exporting the Operations Manager installation.

Params

  • SKIP_SSL_VALIDATION: if true, ssl validation will be skipped. Defaults to false
  • OPSMAN_URL: The OpsManager URL
  • CLIENT_ID: Client ID for accessing OpsManager. If empty, the OPSMAN_USERNAME and OPSMAN_PASSWORD credentials will be used
  • CLIENT_SECRET: Client Secret for accessing OpsManager
  • OPSMAN_USERNAME: The OpsManager username
  • OPSMAN_PASSWORD: The OpsManager password

bbr-backup-ert

To use this task you will need either:

  • a Concourse worker with access to your BOSH Director and ERT/PAS VMs. You can find an example template for deploying an external worker in a different network to your Concouse deployment here
  • or, provide the OPSMAN_PRIVATE_KEY to use an SSH tunnel via the Ops Manager VM. Please note, using an SSH tunnel may increase the time taken to drain backup artifacts from the ERT/PAS VMs. Backup artifacts can be very large and using a proxy will be a significant overhead on network performance.

N.B. this task will run bbr deployment backup from the Concourse worker. Ensure that the Concourse worker has enough disk space to accommodate the ERT/PAS backup artifact.

Inputs:

  • bbr-pipeline-tasks-repo: this repository
  • binary: a directory containing a executable bbr file

Outputs

  • ert-backup-artifact: a directory containing ert-backup.tar generated by backing up ERT.

Params

  • SKIP_SSL_VALIDATION: if true, ssl validation will be skipped. Defaults to false
  • OPSMAN_URL: The OpsManager URL
  • CLIENT_ID: Client ID for accessing OpsManager. If empty, the OPSMAN_USERNAME and OPSMAN_PASSWORD credentials will be used
  • CLIENT_SECRET: Client Secret for accessing OpsManager
  • OPSMAN_USERNAME: The OpsManager username
  • OPSMAN_PASSWORD: The OpsManager password
  • OPSMAN_PRIVATE_KEY: (optional) The OpsManager private key. If provided, the task will export BOSH_ALL_PROXY, which is used by bbr v1.2.6+ to create an SSH tunnel via the Ops Manager VM.

bbr-backup-director

To use this task you will need either:

  • a Concourse worker with access to your BOSH Director. You can find an example template for deploying an external worker in a different network to your Concouse deployment here
  • or, provide the OPSMAN_PRIVATE_KEY to use an SSH tunnel via the Ops Manager VM. Please note, using an SSH tunnel may increase the time taken to drain backup artifacts from the BOSH director. Backup artifacts can be very large and using a proxy will be a significant overhead on network performance.

N.B. this task will run bbr director backup from the Concourse worker. Ensure that the Concourse worker has enough disk space to accommodate the BOSH Director backup artifact.

Inputs:

  • bbr-pipeline-tasks-repo: this repository
  • binary: a directory containing a executable bbr file

Outputs

  • director-backup-artifact: a directory containing director-backup.tar generated by backing up the Director.

Params

  • SKIP_SSL_VALIDATION: if true, ssl validation will be skipped. Defaults to false
  • OPSMAN_URL: The OpsManager URL
  • CLIENT_ID: Client ID for accessing OpsManager. If empty, the OPSMAN_USERNAME and OPSMAN_PASSWORD credentials will be used
  • CLIENT_SECRET: Client Secret for accessing OpsManager
  • OPSMAN_USERNAME: The OpsManager username
  • OPSMAN_PASSWORD: The OpsManager password
  • OPSMAN_PRIVATE_KEY: (optional) The OpsManager private key. If provided, the task will export BOSH_ALL_PROXY, which is used by bbr v1.2.6+ to create an SSH tunnel via the Ops Manager VM.

Example pipeline

You can set the example pipeline with fly:

cp secrets.sample.yml secrets.yml
# update secrets.yml with real secrets
fly --target <target> \
    set-pipeline \
    --pipeline bbr-pipeline \
    --config pipeline.sample.yml \
    --load-vars-from secrets.yml

bbr-pcf-pipeline-tasks's People

Contributors

mirahimage avatar gmrodgers avatar gcapizzi avatar chunyilyu avatar alamages avatar edwardecook avatar shinji62 avatar jukie avatar lancefrench avatar thereses avatar glestaris avatar aclevername avatar mminges avatar goonzoid avatar

Watchers

Minseok Kim avatar James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.