Light

gabfl / pg_dump-to-s3 Goto Github PK

View Code? Open in Web Editor NEW

122.0 5.0 43.0 30 KB

Automatically dump and archive PostgreSQL backups to Amazon S3

Shell 100.00%

pg-dump postgresql s3 database-backup

pg_dump-to-s3's Introduction

pg_dump-to-s3

Automatically dump and archive PostgreSQL backups to Amazon S3.

Requirements

AWS cli: pip install awscli

Setup

Use aws configure to store your AWS credentials in ~/.aws (read documentation)
Edit .conf and set your PostgreSQL's credentials and the list of databases to back up. Optionally, the file can be moved to the home directory in ~/.pg_dump-to-s3.conf.
If your PostgreSQL connection uses a password, you will need to store it in ~/.pgpass (read documentation)

Usage

./pg_dump-to-s3.sh

#  * Backup in progress.,.
#    -> backing up test...
# upload: ../../../tmp/2023-06-28-at-22-20-08_test.dump to s3://*****/backups/2023-06-28-at-22-20-08_test.dump
#       ...database test has been backed up
#  * Deleting old backups...

# ...done!

Restore a backup

# USAGE: pg_restore-from-s3.sh [db target] [s3 object]

./pg_restore-from-s3.sh my_database_1 2023-06-28-at-10-29-44_my_database_1.dump

# download: s3://your_bucket/folder/2023-06-28-at-22-17-15_my_database_1.dump to /tmp/2023-06-28-at-22-17-15_my_database_1.dump
# Database my_database_1 already exists, skipping creation
# 2023-06-28-at-22-17-15_my_database_1.dump restored to database my_database_1

pg_dump-to-s3's People

Contributors

Stargazers

Watchers

pg_dump-to-s3's Issues

add in crontab

when it is included within crontab:

"* 0 * * * /home/pg_dump/pg_dump-to-s3/pg_dump-to-s3.sh >> /home/pg_dump/file.log"

it is not executed from line 48 of the script. since it must go up to s3.
if it runs directly on the home the script works correctly. regards

env bash

Hi there, as suggestion you should use #!/usr/bin/env bash in the script to make it generally compatible, thanks

RDS Postgresql in VPC

let me know how to backup RDS postgresql into S3, when RDS is in private subnet

conf file in home

you could also consider this to have the conf file in home:

[[ -f "$DIR/.conf" ]] && source "$DIR/.conf" || source ${HOME}/.pg_dump-to-s3.conf

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.