Comments (9)
Thank you a lot for reporting.
I'll look into this when I get to build the latest TiKV (related: tikv/tikv#1910).
- Could you provide your
nmz.toml
and TiKV version? - What did you do before/after restarting TiKV?
- Can you execute
cat
for the files under/data1/deploy1/data
?
from namazu.
Thanks @AkihiroSuda
my config is very simple
explorePolicy = "random"
[explorePolicyParam]
minInterval = "80ms"
maxInterval = "300ms"
faultActionProbability = 0.0
procPolicy = "extreme"
I insert many data into TiKV then restart it.
/data1/deploy1/data
is a directory.
I use binary test, not docker, if you want to use docker, you can try
docker pull pingcap/tidb:latest
docker pull pingcap/tikv:latest
docker pull pingcap/pd:latest
from namazu.
You can refer https://github.com/pingcap/docs/blob/master/op-guide/docker-deployment.md to get and deploy with docker.
from namazu.
I could not reproduce the issue with the following procedure:
docker-compose up
with docker-compose.yml- Connect to TiDB with
mysql
; create some table and insert data docker restart tidb_tikv1_1
Some questions:
- Do you hit the issue deterministically?
- https://github.com/derekparker/delve might be useful for analyzing hanging goroutines of nmz
- Setting
NMZ_DEBUG
to 1 might be also useful, but it emits a lot of logs
from namazu.
Thanks @AkihiroSuda
Can you insert data after restarting all TiKVs?
I hit the problem every time, but I don't use docker but just binary. I will use NMZ_DEBUG
to check again.
from namazu.
Hi @AkihiroSuda
I use NMZ_DEBUG, and reproduce it with following duplcated outputs:
[NMZ-DBG] 09:42:52.21: Orchestrator handled action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"d5dbf889-dd4b-4390-9839-7a9e2b177908", "uuid":"1eb7a523-88b6-4e69-8085-f952363de268"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:52.21: EP handling action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"d5dbf889-dd4b-4390-9839-7a9e2b177908", "uuid":"1eb7a523-88b6-4e69-8085-f952363de268"}} (at endpoint.go:124)
[NMZ-DBG] 09:42:52.21: EP handled action Signal{map[string]interface {}{"uuid":"1eb7a523-88b6-4e69-8085-f952363de268", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"d5dbf889-dd4b-4390-9839-7a9e2b177908"}} (at endpoint.go:143)
[NMZ-DBG] 09:42:52.21: LOCAL EP handling action Signal{map[string]interface {}{"uuid":"1eb7a523-88b6-4e69-8085-f952363de268", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"d5dbf889-dd4b-4390-9839-7a9e2b177908"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:52.21: LOCAL EP handled action Signal{map[string]interface {}{"uuid":"1eb7a523-88b6-4e69-8085-f952363de268", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"d5dbf889-dd4b-4390-9839-7a9e2b177908"}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:52.21: Action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"d5dbf889-dd4b-4390-9839-7a9e2b177908", "uuid":"1eb7a523-88b6-4e69-8085-f952363de268", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} (at fs.go:67)
[NMZ-DBG] 09:42:52.45: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"uuid":"493d77d3-c1d5-446f-b58c-f2d720d90912", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"acac5c47-1bb5-475f-b45a-a354f07f8825"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc42165e480)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"uuid":"acac5c47-1bb5-475f-b45a-a354f07f8825", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:52.45: Orchestrator handling action Signal{map[string]interface {}{"event_uuid":"acac5c47-1bb5-475f-b45a-a354f07f8825", "uuid":"493d77d3-c1d5-446f-b58c-f2d720d90912", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:52.45: action Signal{map[string]interface {}{"event_uuid":"acac5c47-1bb5-475f-b45a-a354f07f8825", "uuid":"493d77d3-c1d5-446f-b58c-f2d720d90912", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:52.45: Orchestrator handled action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"acac5c47-1bb5-475f-b45a-a354f07f8825", "uuid":"493d77d3-c1d5-446f-b58c-f2d720d90912", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:52.45: EP handling action Signal{map[string]interface {}{"uuid":"493d77d3-c1d5-446f-b58c-f2d720d90912", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"acac5c47-1bb5-475f-b45a-a354f07f8825"}} (at endpoint.go:124)
[NMZ-DBG] 09:42:52.45: EP handled action Signal{map[string]interface {}{"uuid":"493d77d3-c1d5-446f-b58c-f2d720d90912", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"acac5c47-1bb5-475f-b45a-a354f07f8825"}} (at endpoint.go:143)
[NMZ-DBG] 09:42:52.45: LOCAL EP handling action Signal{map[string]interface {}{"uuid":"493d77d3-c1d5-446f-b58c-f2d720d90912", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"acac5c47-1bb5-475f-b45a-a354f07f8825"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:52.45: LOCAL EP handled action Signal{map[string]interface {}{"type":"action", "event_uuid":"acac5c47-1bb5-475f-b45a-a354f07f8825", "uuid":"493d77d3-c1d5-446f-b58c-f2d720d90912", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:52.45: Action Signal{map[string]interface {}{"uuid":"493d77d3-c1d5-446f-b58c-f2d720d90912", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"acac5c47-1bb5-475f-b45a-a354f07f8825"}} (at fs.go:67)
[NMZ-DBG] 09:42:52.45: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:52.45: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:52.45: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:52.45: Event Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba"}} (at fs.go:61)
[NMZ-DBG] 09:42:52.45: LOCAL EP handling event Signal{map[string]interface {}{"class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "entity":"_namazu_fs_inspector"}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:52.45: LOCAL EP handled event Signal{map[string]interface {}{"uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:52.45: EP handling event Signal{map[string]interface {}{"option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}} (at endpoint.go:163)
[NMZ-DBG] 09:42:52.45: EP handled event Signal{map[string]interface {}{"option":map[string]interface {}{"path":"db/000003.log", "op":"post-read"}, "type":"event", "deferred":true, "uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}} (at endpoint.go:166)
[NMZ-DBG] 09:42:52.45: Orchestrator handling event Signal{map[string]interface {}{"deferred":true, "uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:52.45: Orchestrator handled event Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba"}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:52.45: runtime.NumGoroutine()=25 (at orchestrator.go:138)
[NMZ-DBG] 09:42:52.45: determined duration 194.007246ms (min:80ms, max:300ms) (at impl.go:106)
[NMZ-DBG] 09:42:52.46: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:52.46: Event Signal{map[string]interface {}{"deferred":true, "uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}} (at fs.go:61)
[NMZ-DBG] 09:42:52.46: LOCAL EP handling event Signal{map[string]interface {}{"uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:52.46: LOCAL EP handled event Signal{map[string]interface {}{"deferred":true, "uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:52.46: EP handling event Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982"}} (at endpoint.go:163)
[NMZ-DBG] 09:42:52.46: EP handled event Signal{map[string]interface {}{"uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at endpoint.go:166)
[NMZ-DBG] 09:42:52.46: Orchestrator handling event Signal{map[string]interface {}{"deferred":true, "uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:52.46: Orchestrator handled event Signal{map[string]interface {}{"uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:52.46: runtime.NumGoroutine()=26 (at orchestrator.go:138)
[NMZ-DBG] 09:42:52.46: determined duration 134.278437ms (min:80ms, max:300ms) (at impl.go:106)
[NMZ-DBG] 09:42:52.59: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "uuid":"f282b8ca-637b-4608-9f07-7318f0868d5d", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc4212d1d60)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:52.59: Orchestrator handling action Signal{map[string]interface {}{"uuid":"f282b8ca-637b-4608-9f07-7318f0868d5d", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982"}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:52.59: action Signal{map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "uuid":"f282b8ca-637b-4608-9f07-7318f0868d5d", "entity":"_namazu_fs_inspector"}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:52.59: Orchestrator handled action Signal{map[string]interface {}{"uuid":"f282b8ca-637b-4608-9f07-7318f0868d5d", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:52.59: EP handling action Signal{map[string]interface {}{"uuid":"f282b8ca-637b-4608-9f07-7318f0868d5d", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982"}} (at endpoint.go:124)
[NMZ-DBG] 09:42:52.59: EP handled action Signal{map[string]interface {}{"event_uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "uuid":"f282b8ca-637b-4608-9f07-7318f0868d5d", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} (at endpoint.go:143)
[NMZ-DBG] 09:42:52.59: LOCAL EP handling action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "uuid":"f282b8ca-637b-4608-9f07-7318f0868d5d"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:52.59: LOCAL EP handled action Signal{map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "uuid":"f282b8ca-637b-4608-9f07-7318f0868d5d", "entity":"_namazu_fs_inspector"}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:52.59: Action Signal{map[string]interface {}{"type":"action", "event_uuid":"54e6b0b4-dd6b-4d2a-bb70-ee263d65f982", "uuid":"f282b8ca-637b-4608-9f07-7318f0868d5d", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} (at fs.go:67)
[NMZ-DBG] 09:42:52.65: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "uuid":"f862b81b-ee73-42c8-b77f-11763fd710d5", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc4212d1be0)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:52.65: Orchestrator handling action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "uuid":"f862b81b-ee73-42c8-b77f-11763fd710d5"}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:52.65: action Signal{map[string]interface {}{"uuid":"f862b81b-ee73-42c8-b77f-11763fd710d5", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba"}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:52.65: Orchestrator handled action Signal{map[string]interface {}{"uuid":"f862b81b-ee73-42c8-b77f-11763fd710d5", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:52.65: EP handling action Signal{map[string]interface {}{"event_uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "uuid":"f862b81b-ee73-42c8-b77f-11763fd710d5", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} (at endpoint.go:124)
[NMZ-DBG] 09:42:52.65: EP handled action Signal{map[string]interface {}{"uuid":"f862b81b-ee73-42c8-b77f-11763fd710d5", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba"}} (at endpoint.go:143)
[NMZ-DBG] 09:42:52.65: LOCAL EP handling action Signal{map[string]interface {}{"uuid":"f862b81b-ee73-42c8-b77f-11763fd710d5", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:52.65: LOCAL EP handled action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "uuid":"f862b81b-ee73-42c8-b77f-11763fd710d5", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:52.65: Action Signal{map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"f8d827d3-e621-493e-a3e5-83b7284cd8ba", "uuid":"f862b81b-ee73-42c8-b77f-11763fd710d5", "entity":"_namazu_fs_inspector"}} (at fs.go:67)
[NMZ-DBG] 09:42:52.65: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:52.65: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:52.65: Event Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3"}} (at fs.go:61)
[NMZ-DBG] 09:42:52.65: LOCAL EP handling event Signal{map[string]interface {}{"class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "entity":"_namazu_fs_inspector"}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:52.65: LOCAL EP handled event Signal{map[string]interface {}{"deferred":true, "uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:52.65: EP handling event Signal{map[string]interface {}{"uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at endpoint.go:163)
[NMZ-DBG] 09:42:52.65: EP handled event Signal{map[string]interface {}{"uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at endpoint.go:166)
[NMZ-DBG] 09:42:52.65: Orchestrator handling event Signal{map[string]interface {}{"uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:52.65: Orchestrator handled event Signal{map[string]interface {}{"type":"event", "deferred":true, "uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:52.65: runtime.NumGoroutine()=25 (at orchestrator.go:138)
[NMZ-DBG] 09:42:52.65: determined duration 273.396656ms (min:80ms, max:300ms) (at impl.go:106)
[NMZ-DBG] 09:42:52.92: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"uuid":"a00de90d-4145-49e0-942b-70996877c921", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc42165eba0)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"type":"event", "deferred":true, "uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:52.92: Orchestrator handling action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "uuid":"a00de90d-4145-49e0-942b-70996877c921", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:52.92: action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "uuid":"a00de90d-4145-49e0-942b-70996877c921", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:52.92: Orchestrator handled action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "uuid":"a00de90d-4145-49e0-942b-70996877c921"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:52.92: EP handling action Signal{map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "uuid":"a00de90d-4145-49e0-942b-70996877c921", "entity":"_namazu_fs_inspector"}} (at endpoint.go:124)
[NMZ-DBG] 09:42:52.92: EP handled action Signal{map[string]interface {}{"type":"action", "event_uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "uuid":"a00de90d-4145-49e0-942b-70996877c921", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} (at endpoint.go:143)
[NMZ-DBG] 09:42:52.92: LOCAL EP handling action Signal{map[string]interface {}{"uuid":"a00de90d-4145-49e0-942b-70996877c921", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:52.92: LOCAL EP handled action Signal{map[string]interface {}{"uuid":"a00de90d-4145-49e0-942b-70996877c921", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3"}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:52.92: Action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"078e8837-768f-4032-81a5-ba29cd1b76b3", "uuid":"a00de90d-4145-49e0-942b-70996877c921", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} (at fs.go:67)
[NMZ-DBG] 09:42:52.93: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:52.93: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:52.93: Event Signal{map[string]interface {}{"option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}} (at fs.go:61)
[NMZ-DBG] 09:42:52.93: LOCAL EP handling event Signal{map[string]interface {}{"deferred":true, "uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:52.93: LOCAL EP handled event Signal{map[string]interface {}{"uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:52.93: EP handling event Signal{map[string]interface {}{"type":"event", "deferred":true, "uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}}} (at endpoint.go:163)
[NMZ-DBG] 09:42:52.93: EP handled event Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf"}} (at endpoint.go:166)
[NMZ-DBG] 09:42:52.93: Orchestrator handling event Signal{map[string]interface {}{"uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:52.93: Orchestrator handled event Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf"}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:52.93: runtime.NumGoroutine()=25 (at orchestrator.go:138)
[NMZ-DBG] 09:42:52.93: determined duration 136.103343ms (min:80ms, max:300ms) (at impl.go:106)
[NMZ-DBG] 09:42:53.06: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"event_uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "uuid":"0ec800db-d0d6-4be2-aa26-98db5db354bd", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc42165ed60)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "entity":"_namazu_fs_inspector"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:53.06: Orchestrator handling action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "uuid":"0ec800db-d0d6-4be2-aa26-98db5db354bd"}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:53.06: action Signal{map[string]interface {}{"uuid":"0ec800db-d0d6-4be2-aa26-98db5db354bd", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf"}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:53.06: Orchestrator handled action Signal{map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "uuid":"0ec800db-d0d6-4be2-aa26-98db5db354bd", "entity":"_namazu_fs_inspector"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:53.06: EP handling action Signal{map[string]interface {}{"type":"action", "event_uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "uuid":"0ec800db-d0d6-4be2-aa26-98db5db354bd", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} (at endpoint.go:124)
[NMZ-DBG] 09:42:53.06: EP handled action Signal{map[string]interface {}{"uuid":"0ec800db-d0d6-4be2-aa26-98db5db354bd", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf"}} (at endpoint.go:143)
[NMZ-DBG] 09:42:53.06: LOCAL EP handling action Signal{map[string]interface {}{"event_uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "uuid":"0ec800db-d0d6-4be2-aa26-98db5db354bd", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:53.06: LOCAL EP handled action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "uuid":"0ec800db-d0d6-4be2-aa26-98db5db354bd"}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:53.06: Action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"cdf9c3cf-a31d-4068-b3a9-747c7983b4bf", "uuid":"0ec800db-d0d6-4be2-aa26-98db5db354bd"}} (at fs.go:67)
[NMZ-DBG] 09:42:53.06: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:53.06: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:53.06: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:53.06: Event Signal{map[string]interface {}{"type":"event", "deferred":true, "uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}}} (at fs.go:61)
[NMZ-DBG] 09:42:53.06: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:53.06: Event Signal{map[string]interface {}{"class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "entity":"_namazu_fs_inspector"}} (at fs.go:61)
[NMZ-DBG] 09:42:53.06: LOCAL EP handling event Signal{map[string]interface {}{"uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:53.06: LOCAL EP handled event Signal{map[string]interface {}{"option":map[string]interface {}{"path":"db/000003.log", "op":"post-read"}, "type":"event", "deferred":true, "uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:53.06: LOCAL EP handling event Signal{map[string]interface {}{"uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:53.06: EP handling event Signal{map[string]interface {}{"uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at endpoint.go:163)
[NMZ-DBG] 09:42:53.06: EP handled event Signal{map[string]interface {}{"deferred":true, "uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}} (at endpoint.go:166)
[NMZ-DBG] 09:42:53.06: EP handling event Signal{map[string]interface {}{"uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at endpoint.go:163)
[NMZ-DBG] 09:42:53.06: LOCAL EP handled event Signal{map[string]interface {}{"class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "entity":"_namazu_fs_inspector"}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:53.06: Orchestrator handling event Signal{map[string]interface {}{"uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:53.06: Orchestrator handled event Signal{map[string]interface {}{"class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "entity":"_namazu_fs_inspector"}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:53.06: runtime.NumGoroutine()=25 (at orchestrator.go:138)
[NMZ-DBG] 09:42:53.06: Orchestrator handling event Signal{map[string]interface {}{"uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"path":"db/000003.log", "op":"post-read"}, "type":"event", "deferred":true}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:53.06: Orchestrator handled event Signal{map[string]interface {}{"uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:53.06: runtime.NumGoroutine()=26 (at orchestrator.go:138)
[NMZ-DBG] 09:42:53.06: determined duration 238.005276ms (min:80ms, max:300ms) (at impl.go:106)
[NMZ-DBG] 09:42:53.06: determined duration 133.010193ms (min:80ms, max:300ms) (at impl.go:106)
[NMZ-DBG] 09:42:53.06: EP handled event Signal{map[string]interface {}{"option":map[string]interface {}{"path":"db/000003.log", "op":"post-read"}, "type":"event", "deferred":true, "uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}} (at endpoint.go:166)
[NMZ-DBG] 09:42:53.20: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"uuid":"9cc6073a-c30c-457a-af00-7fc558a446f0", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc421670480)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:53.20: Orchestrator handling action Signal{map[string]interface {}{"event_uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "uuid":"9cc6073a-c30c-457a-af00-7fc558a446f0", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:53.20: action Signal{map[string]interface {}{"type":"action", "event_uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "uuid":"9cc6073a-c30c-457a-af00-7fc558a446f0", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:53.20: Orchestrator handled action Signal{map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "uuid":"9cc6073a-c30c-457a-af00-7fc558a446f0", "entity":"_namazu_fs_inspector"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:53.20: EP handling action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "uuid":"9cc6073a-c30c-457a-af00-7fc558a446f0"}} (at endpoint.go:124)
[NMZ-DBG] 09:42:53.20: EP handled action Signal{map[string]interface {}{"uuid":"9cc6073a-c30c-457a-af00-7fc558a446f0", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b"}} (at endpoint.go:143)
[NMZ-DBG] 09:42:53.20: LOCAL EP handling action Signal{map[string]interface {}{"uuid":"9cc6073a-c30c-457a-af00-7fc558a446f0", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:53.20: LOCAL EP handled action Signal{map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "uuid":"9cc6073a-c30c-457a-af00-7fc558a446f0", "entity":"_namazu_fs_inspector"}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:53.20: Action Signal{map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"ce9453c1-2d54-40ee-995f-8c56fdd21f5b", "uuid":"9cc6073a-c30c-457a-af00-7fc558a446f0", "entity":"_namazu_fs_inspector"}} (at fs.go:67)
[NMZ-DBG] 09:42:53.20: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:53.20: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:53.20: Event Signal{map[string]interface {}{"uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at fs.go:61)
[NMZ-DBG] 09:42:53.20: LOCAL EP handling event Signal{map[string]interface {}{"option":map[string]interface {}{"path":"db/000003.log", "op":"post-read"}, "type":"event", "deferred":true, "uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:53.20: LOCAL EP handled event Signal{map[string]interface {}{"uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:53.20: EP handling event Signal{map[string]interface {}{"deferred":true, "uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}} (at endpoint.go:163)
[NMZ-DBG] 09:42:53.20: EP handled event Signal{map[string]interface {}{"option":map[string]interface {}{"path":"db/000003.log", "op":"post-read"}, "type":"event", "deferred":true, "uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}} (at endpoint.go:166)
[NMZ-DBG] 09:42:53.20: Orchestrator handling event Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e"}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:53.20: Orchestrator handled event Signal{map[string]interface {}{"uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:53.20: runtime.NumGoroutine()=26 (at orchestrator.go:138)
[NMZ-DBG] 09:42:53.20: determined duration 124.658254ms (min:80ms, max:300ms) (at impl.go:106)
[NMZ-DBG] 09:42:53.30: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "uuid":"e36395ff-e948-4c0d-a0bc-0fc30735dd30"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc4214a63e0)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"deferred":true, "uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:53.30: Orchestrator handling action Signal{map[string]interface {}{"uuid":"e36395ff-e948-4c0d-a0bc-0fc30735dd30", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4"}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:53.30: action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "uuid":"e36395ff-e948-4c0d-a0bc-0fc30735dd30"}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:53.30: Orchestrator handled action Signal{map[string]interface {}{"uuid":"e36395ff-e948-4c0d-a0bc-0fc30735dd30", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:53.30: EP handling action Signal{map[string]interface {}{"type":"action", "event_uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "uuid":"e36395ff-e948-4c0d-a0bc-0fc30735dd30", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} (at endpoint.go:124)
[NMZ-DBG] 09:42:53.30: EP handled action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "uuid":"e36395ff-e948-4c0d-a0bc-0fc30735dd30"}} (at endpoint.go:143)
[NMZ-DBG] 09:42:53.30: LOCAL EP handling action Signal{map[string]interface {}{"type":"action", "event_uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4", "uuid":"e36395ff-e948-4c0d-a0bc-0fc30735dd30", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:53.30: LOCAL EP handled action Signal{map[string]interface {}{"uuid":"e36395ff-e948-4c0d-a0bc-0fc30735dd30", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4"}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:53.30: Action Signal{map[string]interface {}{"uuid":"e36395ff-e948-4c0d-a0bc-0fc30735dd30", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"92f2541e-c6d7-4661-ab14-4bb7164c75b4"}} (at fs.go:67)
[NMZ-DBG] 09:42:53.32: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"uuid":"a619a074-ba86-4e69-a9f5-f70f25d4efdc", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc421670560)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:53.32: Orchestrator handling action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "uuid":"a619a074-ba86-4e69-a9f5-f70f25d4efdc", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:53.32: action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "uuid":"a619a074-ba86-4e69-a9f5-f70f25d4efdc", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:53.32: Orchestrator handled action Signal{map[string]interface {}{"uuid":"a619a074-ba86-4e69-a9f5-f70f25d4efdc", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:53.32: EP handling action Signal{map[string]interface {}{"uuid":"a619a074-ba86-4e69-a9f5-f70f25d4efdc", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e"}} (at endpoint.go:124)
[NMZ-DBG] 09:42:53.32: EP handled action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "uuid":"a619a074-ba86-4e69-a9f5-f70f25d4efdc"}} (at endpoint.go:143)
[NMZ-DBG] 09:42:53.32: LOCAL EP handling action Signal{map[string]interface {}{"event_uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "uuid":"a619a074-ba86-4e69-a9f5-f70f25d4efdc", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:53.32: LOCAL EP handled action Signal{map[string]interface {}{"uuid":"a619a074-ba86-4e69-a9f5-f70f25d4efdc", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e"}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:53.32: Action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"03a818ac-9ad5-42a0-85d9-7ac5de80449e", "uuid":"a619a074-ba86-4e69-a9f5-f70f25d4efdc", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} (at fs.go:67)
[NMZ-DBG] 09:42:53.33: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:53.33: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:53.33: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:53.33: Event Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102"}} (at fs.go:61)
[NMZ-DBG] 09:42:53.33: LOCAL EP handling event Signal{map[string]interface {}{"uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"path":"db/000003.log", "op":"post-read"}, "type":"event", "deferred":true}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:53.33: LOCAL EP handled event Signal{map[string]interface {}{"class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "entity":"_namazu_fs_inspector"}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:53.33: EP handling event Signal{map[string]interface {}{"deferred":true, "uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}} (at endpoint.go:163)
[NMZ-DBG] 09:42:53.33: EP handled event Signal{map[string]interface {}{"uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at endpoint.go:166)
[NMZ-DBG] 09:42:53.33: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:53.33: Event Signal{map[string]interface {}{"uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at fs.go:61)
[NMZ-DBG] 09:42:53.33: LOCAL EP handling event Signal{map[string]interface {}{"uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:53.33: LOCAL EP handled event Signal{map[string]interface {}{"uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:53.33: Orchestrator handling event Signal{map[string]interface {}{"uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:53.33: EP handling event Signal{map[string]interface {}{"class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "entity":"_namazu_fs_inspector"}} (at endpoint.go:163)
[NMZ-DBG] 09:42:53.33: Orchestrator handled event Signal{map[string]interface {}{"class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "entity":"_namazu_fs_inspector"}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:53.33: runtime.NumGoroutine()=25 (at orchestrator.go:138)
[NMZ-DBG] 09:42:53.33: Orchestrator handling event Signal{map[string]interface {}{"type":"event", "deferred":true, "uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:53.33: Orchestrator handled event Signal{map[string]interface {}{"uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:53.33: runtime.NumGoroutine()=26 (at orchestrator.go:138)
[NMZ-DBG] 09:42:53.33: EP handled event Signal{map[string]interface {}{"option":map[string]interface {}{"path":"db/000003.log", "op":"post-read"}, "type":"event", "deferred":true, "uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}} (at endpoint.go:166)
[NMZ-DBG] 09:42:53.33: determined duration 193.283074ms (min:80ms, max:300ms) (at impl.go:106)
[NMZ-DBG] 09:42:53.33: determined duration 211.79578ms (min:80ms, max:300ms) (at impl.go:106)
[NMZ-DBG] 09:42:53.52: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "uuid":"c70018e0-7d14-4f53-bf40-9267a3297d31", "entity":"_namazu_fs_inspector"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc4211f5b00)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:53.52: Orchestrator handling action Signal{map[string]interface {}{"type":"action", "event_uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "uuid":"c70018e0-7d14-4f53-bf40-9267a3297d31", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:53.52: action Signal{map[string]interface {}{"type":"action", "event_uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "uuid":"c70018e0-7d14-4f53-bf40-9267a3297d31", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:53.52: Orchestrator handled action Signal{map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "uuid":"c70018e0-7d14-4f53-bf40-9267a3297d31", "entity":"_namazu_fs_inspector"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:53.52: EP handling action Signal{map[string]interface {}{"uuid":"c70018e0-7d14-4f53-bf40-9267a3297d31", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102"}} (at endpoint.go:124)
[NMZ-DBG] 09:42:53.52: EP handled action Signal{map[string]interface {}{"type":"action", "event_uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "uuid":"c70018e0-7d14-4f53-bf40-9267a3297d31", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} (at endpoint.go:143)
[NMZ-DBG] 09:42:53.52: LOCAL EP handling action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "uuid":"c70018e0-7d14-4f53-bf40-9267a3297d31"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:53.52: LOCAL EP handled action Signal{map[string]interface {}{"uuid":"c70018e0-7d14-4f53-bf40-9267a3297d31", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102"}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:53.52: Action Signal{map[string]interface {}{"event_uuid":"63270fe8-4175-4bd2-9f90-478bbc5bc102", "uuid":"c70018e0-7d14-4f53-bf40-9267a3297d31", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} (at fs.go:67)
[NMZ-DBG] 09:42:53.52: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:53.52: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:53.52: Event Signal{map[string]interface {}{"type":"event", "deferred":true, "uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}}} (at fs.go:61)
[NMZ-DBG] 09:42:53.52: LOCAL EP handling event Signal{map[string]interface {}{"uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:53.52: LOCAL EP handled event Signal{map[string]interface {}{"type":"event", "deferred":true, "uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:53.52: EP handling event Signal{map[string]interface {}{"uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at endpoint.go:163)
[NMZ-DBG] 09:42:53.52: EP handled event Signal{map[string]interface {}{"uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at endpoint.go:166)
[NMZ-DBG] 09:42:53.52: Orchestrator handling event Signal{map[string]interface {}{"option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:53.52: Orchestrator handled event Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6"}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:53.52: runtime.NumGoroutine()=26 (at orchestrator.go:138)
[NMZ-DBG] 09:42:53.52: determined duration 184.55625ms (min:80ms, max:300ms) (at impl.go:106)
[NMZ-DBG] 09:42:53.54: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"event_uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "uuid":"342c4e77-3e88-46b6-abe7-3412c996d290", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc4211f5c00)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "entity":"_namazu_fs_inspector"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:53.54: Orchestrator handling action Signal{map[string]interface {}{"uuid":"342c4e77-3e88-46b6-abe7-3412c996d290", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2"}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:53.54: action Signal{map[string]interface {}{"event_uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "uuid":"342c4e77-3e88-46b6-abe7-3412c996d290", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:53.54: Orchestrator handled action Signal{map[string]interface {}{"class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "uuid":"342c4e77-3e88-46b6-abe7-3412c996d290", "entity":"_namazu_fs_inspector"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:53.54: EP handling action Signal{map[string]interface {}{"uuid":"342c4e77-3e88-46b6-abe7-3412c996d290", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2"}} (at endpoint.go:124)
[NMZ-DBG] 09:42:53.54: EP handled action Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "uuid":"342c4e77-3e88-46b6-abe7-3412c996d290"}} (at endpoint.go:143)
[NMZ-DBG] 09:42:53.54: LOCAL EP handling action Signal{map[string]interface {}{"event_uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "uuid":"342c4e77-3e88-46b6-abe7-3412c996d290", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:53.54: LOCAL EP handled action Signal{map[string]interface {}{"type":"action", "event_uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "uuid":"342c4e77-3e88-46b6-abe7-3412c996d290", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:53.54: Action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"77b6d7c1-49c8-4722-911c-84c4bb6956c2", "uuid":"342c4e77-3e88-46b6-abe7-3412c996d290", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} (at fs.go:67)
[NMZ-DBG] 09:42:53.71: RANDOM: Determined action &signal.EventAcceptanceAction{BasicPBAction:signal.BasicPBAction{BasicAction:signal.BasicAction{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"uuid":"0738eed3-efa8-4ed1-a9ef-477666211bc1", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6"}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, Triggered:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}, CauseEvent:(*signal.BasicEvent)(0xc4214a6c00)}}} for event &signal.FilesystemEvent{BasicEvent:signal.BasicEvent{BasicSignal:signal.BasicSignal{M:map[string]interface {}{"uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}, Arrived:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}}} (at randompolicy.go:324)
[NMZ-DBG] 09:42:53.71: Orchestrator handling action Signal{map[string]interface {}{"type":"action", "event_uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6", "uuid":"0738eed3-efa8-4ed1-a9ef-477666211bc1", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}}} (at orchestrator.go:97)
[NMZ-DBG] 09:42:53.71: action Signal{map[string]interface {}{"uuid":"0738eed3-efa8-4ed1-a9ef-477666211bc1", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6"}} is executable on the orchestrator side: false (at orchestrator.go:102)
[NMZ-DBG] 09:42:53.71: Orchestrator handled action Signal{map[string]interface {}{"event_uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6", "uuid":"0738eed3-efa8-4ed1-a9ef-477666211bc1", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action"}} (at orchestrator.go:120)
[NMZ-DBG] 09:42:53.71: EP handling action Signal{map[string]interface {}{"uuid":"0738eed3-efa8-4ed1-a9ef-477666211bc1", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6"}} (at endpoint.go:124)
[NMZ-DBG] 09:42:53.71: EP handled action Signal{map[string]interface {}{"uuid":"0738eed3-efa8-4ed1-a9ef-477666211bc1", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6"}} (at endpoint.go:143)
[NMZ-DBG] 09:42:53.71: LOCAL EP handling action Signal{map[string]interface {}{"uuid":"0738eed3-efa8-4ed1-a9ef-477666211bc1", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6"}} (at localendpoint.go:74)
[NMZ-DBG] 09:42:53.71: LOCAL EP handled action Signal{map[string]interface {}{"uuid":"0738eed3-efa8-4ed1-a9ef-477666211bc1", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction", "option":map[string]interface {}{}, "type":"action", "event_uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6"}} (at localendpoint.go:76)
[NMZ-DBG] 09:42:53.71: Action Signal{map[string]interface {}{"option":map[string]interface {}{}, "type":"action", "event_uuid":"66099e99-eb38-4f26-8a6d-e4d0f28d28c6", "uuid":"0738eed3-efa8-4ed1-a9ef-477666211bc1", "entity":"_namazu_fs_inspector", "class":"EventAcceptanceAction"}} (at fs.go:67)
[NMZ-DBG] 09:42:53.71: PreRead {db/000003.log} (at fs.go:83)
[NMZ-DBG] 09:42:53.71: PostRead {db/000003.log} (at fs.go:89)
[NMZ-DBG] 09:42:53.71: Event Signal{map[string]interface {}{"option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"2158ed7c-c081-4d30-9910-1537c6982499", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent"}} (at fs.go:61)
[NMZ-DBG] 09:42:53.71: LOCAL EP handling event Signal{map[string]interface {}{"uuid":"2158ed7c-c081-4d30-9910-1537c6982499", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"path":"db/000003.log", "op":"post-read"}, "type":"event", "deferred":true}} (at localendpoint.go:47)
[NMZ-DBG] 09:42:53.71: LOCAL EP handled event Signal{map[string]interface {}{"type":"event", "deferred":true, "uuid":"2158ed7c-c081-4d30-9910-1537c6982499", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}}} (at localendpoint.go:49)
[NMZ-DBG] 09:42:53.71: EP handling event Signal{map[string]interface {}{"uuid":"2158ed7c-c081-4d30-9910-1537c6982499", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at endpoint.go:163)
[NMZ-DBG] 09:42:53.71: EP handled event Signal{map[string]interface {}{"deferred":true, "uuid":"2158ed7c-c081-4d30-9910-1537c6982499", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event"}} (at endpoint.go:166)
[NMZ-DBG] 09:42:53.71: Orchestrator handling event Signal{map[string]interface {}{"entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true, "uuid":"2158ed7c-c081-4d30-9910-1537c6982499"}} (at orchestrator.go:86)
[NMZ-DBG] 09:42:53.71: Orchestrator handled event Signal{map[string]interface {}{"uuid":"2158ed7c-c081-4d30-9910-1537c6982499", "entity":"_namazu_fs_inspector", "class":"FilesystemEvent", "option":map[string]interface {}{"op":"post-read", "path":"db/000003.log"}, "type":"event", "deferred":true}} (at orchestrator.go:88)
[NMZ-DBG] 09:42:53.71: runtime.NumGoroutine()=25 (at orchestrator.go:138)
[NMZ-DBG] 09:42:53.71: determined duration 86.405047ms (min:80ms, max:300ms) (at impl.go:106)
from namazu.
Hi, any update? @AkihiroSuda
from namazu.
Hi @AkihiroSuda
Maybe I have found the problem. I insert many data and the RocksDB size is huge, after restarting, RocksDB tries to recover from the WAL, but the WAL size is about 100MB+, so the recovery takes a very large time (> 1 hour).
from namazu.
thank you for reporting and sorry for late reply 😅
from namazu.
Related Issues (20)
- Apply Namazu to logcabin
- Apply Namazu to TiKV, TiDB HOT 2
- Flaky test? (endpoint) HOT 2
- Project Rename: Earthquake --> Namazu
- Use package manager (govendor or something else) HOT 2
- LOW HANGING FRUIT: make goreportcard happy
- `nmz inspectors proc -cmd ...` lacks stdio HOT 1
- Print a warning if `sched_setattr` returns EPERM
- Flaky test: nmz/endpoint HOT 2
- Enable fs inspector in container mode HOT 3
- [doc] Mention and promote Namazu Swarm: CI Job Parallelizer built on Docker and Kubernetes
- Can not get mflag:Docker has removed pkg/mflag HOT 3
- runtime panic of process inspector HOT 2
- namazu has error when using O_DIRECT HOT 3
- scientific paper HOT 1
- How to enable/disable inspector explictily HOT 4
- how to stop inspector HOT 2
- Some problems met when installing the namazu. HOT 6
- Does NAMAZU support CentOS HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from namazu.