conduitio-labs / conduit-connector-azure-storage Goto Github PK

Bug description

It seems that CDC doesn't work properly with Azure's BlockBlob type, it only works with AppendBlob.

Steps to reproduce

1. Create a blob with BlockBlob type;
2. Update the blob;
3. Connector recognizes the update as insert;
4. Delete the blob;
5. Connector doesn't recognize the delete.

Version

0364a85

Bug description

When the connector is in the CDC mode everything is okay, except when you want to pause a running pipeline and resume it after some time. In this case, the last operation performed before a pipeline pause will be duplicated after the pipeline resume.

Steps to reproduce

1. Create and start a Conduit pipeline with Azure source and any destination;
2. Wait until the Azure connector is switched to the CDC mode;
3. Update any existing blob, the update should be written to a destination;
4. Stop the pipeline;
5. Resume the pipeline;
6. The update from step 3 is duplicated and written to a destination again.

Version

db39e39

Feature description

We have two acceptance tests related to CDC failing (for more context: #6 (comment)).