actiontech / dtle-docs-cn Goto Github PK

dtle is run by the latest docker
source is rds 8.0
des is rds 5.7
can get the full data,but can't get the incremential data

Here is the job_stage info
curl -XGET "127.0.0.1:4646/v1/job/dtle-sync-test-hq-quote-bz/allocations" | jq '.' | grep job_stage
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 6154 0 6154 0 0 5745k 0 --:--:-- --:--:-- --:--:-- 6009k
"DisplayMessage": "job_stage_full",
"DriverMessage": "job_stage_full",
"DisplayMessage": "job_stage_incr",
"DriverMessage": "job_stage_incr",

the dtle docker log
2021-12-09T03:35:39.301Z [INFO] client.gc: garbage collecting allocation: alloc_id=a13a55c8-0995-5ec8-9de2-02a3c000a635 reason="forced collection"
2021-12-09T03:35:39.301Z [INFO] client.gc: garbage collecting allocation: alloc_id=968b1f0b-b4a7-49de-c05c-09d3d6914e80 reason="forced collection"
2021-12-09T03:35:39.301Z [INFO] client.gc: garbage collecting allocation: alloc_id=aa7ddcd8-4b13-2e8b-54bb-284f6033ea82 reason="forced collection"
2021-12-09T03:35:39.301Z [INFO] client.gc: garbage collecting allocation: alloc_id=4a424ffa-2cf7-fb8b-949e-21abf1557c75 reason="forced collection"
2021-12-10T03:04:54.090Z [ERROR] client.driver_mgr.dtle: unexpected error on publish: driver=dtle @module=dtle.extractor err="nats: timeout" job=dtle-sync-test-hq-quote-bz timestamp=2021-12-10T03:04:54.089Z
2021-12-10T03:04:54.090Z [ERROR] client.driver_mgr.dtle: onError: driver=dtle @module=dtle.extractor err="nats: timeout" job=dtle-sync-test-hq-quote-bz timestamp=2021-12-10T03:04:54.090Z
2021-12-10T03:04:54.090Z [INFO] client.driver_mgr.dtle: extractor shutdown: driver=dtle @module=dtle.extractor job=dtle-sync-test-hq-quote-bz timestamp=2021-12-10T03:04:54.090Z
2021-12-10T03:04:54.092Z [INFO] client.driver_mgr.dtle: DestroyTask: driver=dtle @module=dtle id=954956ca-b823-a73f-df78-4c160b4ed0e4/src/13fc2e71 timestamp=2021-12-10T03:04:54.092Z

We need to give demo on doc about how to write dtle.cnf when we want to setup a dtle cluster with N nodes.

We need dtle.conf demo with all parameter in Document description with all parameter .

From dtle QQ user group ID Select.简单(736053407)

I run a docker image with
docker run --name dtle -p 8190:8190 --network=dtle-net -d actiontech/dtle

when I 'docker ps ' I get a message that this container is running.
f99bd8b279df actiontech/dtle "/usr/bin/dtle serve…" 18 minutes ago Up 18 minutes 0.0.0.0:8190->8190/tcp dtle

I issue the command docker logs dtle, but this command returns nothing.