In addition to supporting the sqlite task history backend, this container includes all of the dependencies to use the mysql and postgresql backends.

All available images

Uses pip to install luigi and dependencies

• axiom/docker-luigi:latest-alpine (2.8.13)
• axiom/docker-luigi:{version}-alpine

Uses conda to install luigi and dependencies

• axiom/docker-luigi:latest (2.8.13)
• axiom/docker-luigi:{version}

Both luigi and luigid load their configuration from /etc/luigi/.

• Configuration: /etc/luigi/luigi.conf
• Logging: /etc/luigi/logging.conf

Mount a directory containing a luigi.conf and logging.conf file(s) to /etc/luigi to provide your own configuration(s).

docker run \
    -v /your/directory:/etc/luigi \
   axiom/docker-luigi

Or mount a single configuration file:

docker run \
    -v /your/directory/logging.conf:/etc/luigi/logging.conf \
   axiom/docker-luigi

The default can be found in the luigi.conf and logging.conf files in this repository. Be aware that these specify the paths to the logging configration and the state persistence database. If you change these values in luigi.conf the examples in this document will not work!

Mount a volume at /luigi/state for the luigid state to be persisted between restarts. Example below uses a named docker volume to persist the state:

docker run \
    -v luigistate:/luigi/state \
    axiom/docker-luigi

docker-compose -f tests/docker-compose.yml up -d maria pgsql
# Wait ~10s for databases to start
docker-compose -f tests/docker-compose.yml build
docker-compose -f tests/docker-compose.yml up
docker-compose down