I'm encountering a problem within the RuleChains. Occasionally, logs seem to disappear

<a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/us

By default, there is a rate limit for debug node events: <div class="snippet-clipb

Logs and data lost in rulechain about thingsboard HOT 3 OPEN

MartinCouadeau commented on June 3, 2024

Logs and data lost in rulechain

from thingsboard.

Comments (3)

trikimiki commented on June 3, 2024

Hi!
What kind of deployment you are using?

from thingsboard.

devdoob commented on June 3, 2024

@trikimiki I am also facing this issue.

I have Postgres behind, deployed on EC2

from thingsboard.

trikimiki commented on June 3, 2024

By default, there is a rate limit for debug node events:

  rule:
  <...>
    chain:
      # Errors for particular actors are persisted once per specified amount of milliseconds
      error_persist_frequency: "${ACTORS_RULE_CHAIN_ERROR_FREQUENCY:3000}"
      debug_mode_rate_limits_per_tenant:
        # Enable/Disable the rate limit of persisted debug events for all rule nodes per tenant
        enabled: "${ACTORS_RULE_CHAIN_DEBUG_MODE_RATE_LIMITS_PER_TENANT_ENABLED:true}"
        # The value of DEBUG mode rate limit. By default, no more then 50 thousand events per hour
        configuration: "${ACTORS_RULE_CHAIN_DEBUG_MODE_RATE_LIMITS_PER_TENANT_CONFIGURATION:50000:3600}"
   <...>

If you enabled the debug node on every other rule node, you could have reached this limit, so events were discarded in your case. If the event was not saved, the data is still being processed.

As about lost data - there are many reasons this could have happened. If you cannot investigate debug events, you can still try checking API Usage stats for Rule Engine (timeouts/failures/exceptions), or backend log files.

from thingsboard.

Recommend Projects