Change Data Capture (CDC) tool from any source(s) to any target.

• Does not require any change to sources data model (e.g. no need to add a last_updated column)
• Multi-source, with ability to set merge/aggregation constraints
• Able to handle several data types, with link (foreign keys) between them, and to enforce integrity constraints
• Able to transform data with Jinja filters in configuration files: no need to edit some Python code
• Clean error handling, to avoid synchronization problems, and an optional mechanism of error remediation
• Offer a trashbin on clients for removed data
• Insensitive to unavailability and errors on each link (source, message bus, target)
• Easy to extend by design. All following items are implemented as plugins:
  • Datasources
  • Attributes filters (data filters)
  • Clients (targets)
  • Messagebus
• Changes to the datamodel are easy and safe to integrate and propagate, whether on the server or on the clients

• Allow changing primary keys values safely (server and clients)
• Add a facultative option to remediate errors by merging added/modified events of a same object in errorqueue (clients)
• Write documentation for
  • installing
  • using
  • examples
  • developping a plugin
  • contributing to core
• Write functional tests
• Write more tests
• (Maybe) Implement data consistency check when initsync sequence is met on an already initialized client (clients)
• (Maybe) Force remote primary keys in client datamodel. Requires a lot of troubleshooting to safely update "internal" attrnames and values on Dataschema primary key change: in Datasources and Errorqueue
• (Maybe) Implement a check to ensure clients subclasses required types and attributes are set in datamodel

Contributions are always welcome, but may take some time to be merged.

Documentation

GNU GPLv3

• @Boris Lechner