fluent / fluent-operator Goto Github PK

View Code? Open in Web Editor NEW

554.0 24.0 223.0 20.17 MB

Operate Fluent Bit and Fluentd in the Kubernetes way - Previously known as FluentBit Operator

License: Apache License 2.0

Dockerfile 0.57% Makefile 1.12% Go 96.05% Lua 0.08% Shell 1.89% Mustache 0.29%

fluentbit operator kubernetes kubesphere logging fluentd

fluent-operator's Introduction

Facilitate the management of Fluent Bit and Fluentd in Kubernetes

Fluent Operator

Fluent Operator provides great flexibility in building a logging layer based on Fluent Bit and Fluentd.

Once installed, the Fluent Operator provides the following features:

Fluent Bit Management: Deploy and destroy Fluent Bit DaemonSet automatically.
Fluentd Management: Deploy and destroy Fluentd StatefulSet automatically.
Custom Configuration: Select input/filter/output plugins via labels.
Dynamic Reloading: Update configuration without rebooting Fluent Bit and Fluentd pods.
Multi-tenant log isolation: Fluentd supports multi-tenant log isolation through label_router plugin.
Pluggable deployment components: Either Fluent Bit or Fluentd can be deployed separately.

Fluent Operator

Overview

Although both Fluent Bit and Fluentd can collect, process(parse and filter) and then forward log to the final destinations, still they have strengths in different aspects.

Fluent Bit is a good choice as a logging agent because of its lightweight and efficiency, while Fluentd is more powerful to perform advanced processing on logs because of its rich plugins.

Fluent Bit only mode: If you just need to collect logs and send logs to the final destinations, all you need is Fluent Bit.
Fluent Bit + Fluentd mode: If you also need to perform some advanced processing on the logs collected or send to more sinks, then you also need Fluentd.
Fluentd only mode: If you need to receive logs through networks like HTTP or Syslog and then process and send the log to the final sinks, you only need Fluentd.

Fluent Operator includes CRDs and controllers for both Fluent Bit and Fluentd which allows you to config your log processing pipelines in the 3 modes mentioned above as you wish.

Fluent Bit will be deployed as a DaemonSet while Fluentd will be deployed as a StatefulSet. The whole workflow could be described as below:

Fluent Bit

The following CRDs are defined for Fluent Bit:

FluentBit: Defines the Fluent Bit DaemonSet and its configs. A custom Fluent Bit image kubesphere/fluent-bit is required to work with FluentBit Operator for dynamic configuration reloading.
ClusterFluentBitConfig: Select cluster-level input/filter/output plugins and generates the final config into a Secret.
FluentBitConfig: Selects namespace-level filter/output/parser and cluster-level parser plugins and generates final config into a Secret.
ClusterInput: Defines cluster-level input config sections.
Parser: Defines namespace-level parser config sections.
ClusterParser: Defines cluster-level parser config sections.
Filter: Defines namespace-level filter config sections.
ClusterFilter: Defines cluster-level filter config sections.
Output: Defines namespace-level output config sections.
ClusterOutput: Defines cluster-level output config sections.

Each ClusterInput, ClusterParser, ClusterFilter, ClusterOutput represents a Fluent Bit config section, which are selected by ClusterFluentBitConfig via label selectors. Fluent Operator watches those objects, constructs the final config, and finally creates a Secret to store the config which will be mounted into the Fluent Bit DaemonSet. The entire workflow looks like below:

To enable Fluent Bit to pick up and use the latest config whenever the Fluent Bit config changes, a wrapper called Fluent Bit watcher is added to restart the Fluent Bit process as soon as Fluent Bit config changes are detected. This way, the Fluent Bit pod needn't be restarted to reload the new config. The Fluent Bit config is reloaded in this way because there is no reloading interface in Fluent Bit itself. Please refer to this known issue for more details.

Fluentd

The following CRDs are defined for Fluentd:

Fluentd: Defines the Fluentd Statefulset and its configs. A custom Fluentd image kubesphere/fluentd is required to work with Fluentd Operator for dynamic configuration reloading.
FluentdConfig: Select cluster-level or namespace-level scope input/filter/output plugins and generates the final config into a Secret.
ClusterFluentdConfig: Select cluster-level input/filter/output plugins and generates the final config into a Secret.
Filter: Defines namespace-level filter config sections.
ClusterFilter: Defines cluster-level filter config sections.
Output: Defines namespace-level output config sections.
ClusterOutput: Defines cluster-level output config sections.

Get Started

Prerequisites

Kubernetes v1.16.13+ is necessary for running Fluent Operator.

Install

Deploy Fluent Operator with YAML

Install the latest stable version

kubectl apply -f https://raw.githubusercontent.com/fluent/fluent-operator/release-2.9/manifests/setup/setup.yaml

# You can change the namespace in manifests/setup/kustomization.yaml in corresponding release branch 
# and then use command below to install to another namespace
# kubectl kustomize manifests/setup/ | kubectl apply -f -

Install the development version

kubectl apply -f https://raw.githubusercontent.com/fluent/fluentbit-operator/master/manifests/setup/setup.yaml

# You can change the namespace in manifests/setup/kustomization.yaml 
# and then use command below to install to another namespace
# kubectl kustomize manifests/setup/ | kubectl apply -f -

Deploy Fluent Operator with Helm

Note: For the helm based install, Helm v3.2.1 or higher is needed.

The Fluent Bit section of the Fluent Operator supports different CRI docker, containerd, and CRI-O. containerd and CRI-O use the CRI Log format which is different with docker, they requires additional parser to parse JSON application logs. You should set different containerRuntime depending on your container runtime.

The default runtime is docker, you can choose other runtimes as follows.

If your container runtime is containerd or cri-o, you can set the containerRuntime parameter to containerd or crio. e.g.

helm install fluent-operator --create-namespace -n fluent charts/fluent-operator/  --set containerRuntime=containerd

Install through the online chart link:

helm install fluent-operator --create-namespace -n fluent https://github.com/fluent/fluent-operator/releases/download/< version >/fluent-operator.tgz

Please replace < version > with a actual version like v1.0.0

Fluent Operator CRDs will be installed by default when running a helm install for the chart. But if the CRD already exists, it will be skipped with a warning. So make sure you install the CRDs by yourself if you upgrade your Fluent Operator version.

By default the installation with Helm create all the CRDs (fluent-bit and fluentd ones). If you do not intent to use one of the two components, it is possible to skip its CRDs and also to not start the controllers for it in the operator. To achieve that operator.disableComponentControllers and (fluent-bit/fluentd).crdsEnable parameters can be provided:

helm install fluent-operator --create-namespace -n fluent charts/fluent-operator/  --set operator.disableComponentControllers=fluent-bit,fluent-bit.crdsEnable=false

Note: During the upgrade process, if a CRD was previously created using the create operation, an error will occur during the apply operation. Using apply here allows the CRD to be replaced and created in its entirety in a single operation.

To replace the CRDs pull the current helm chart:

wget https://github.com/fluent/fluent-operator/releases/download/<version>/fluent-operator.tgz
tar -xf fluent-operator.tgz

To update the CRDs, run the following command:

kubectl replace -f fluent-operator/crds

Fluent Operator Walkthrough

For more info on various use cases of Fluent Operator, you can refer to Fluent-Operator-Walkthrough.

Collect Kubernetes logs

This guide provisions a logging pipeline including the Fluent Bit DaemonSet and its log input/filter/output configurations to collect Kubernetes logs including container logs and kubelet logs.

Note that you need a running Elasticsearch v5+ cluster to receive log data before start. Remember to adjust output-elasticsearch.yaml to your own es setup. Kafka and Fluentd outputs are optional and are turned off by default.

Deploy the Kubernetes logging stack with YAML

kubectl apply -f manifests/logging-stack

# You can change the namespace in manifests/logging-stack/kustomization.yaml 
# and then use command below to install to another namespace
# kubectl kustomize manifests/logging-stack/ | kubectl apply -f -

Deploy the Kubernetes logging pipeline with Helm

You can also deploy the Kubernetes logging pipeline with Helm, just need to set the Kubernetes parameter to true (default):

helm upgrade fluent-operator --create-namespace -n fluent charts/fluent-operator/  --set containerRuntime=docker

If you want to deploy fluentd, just need to set the fluentd.enable parameter to true:

helm upgrade fluent-operator --create-namespace -n fluent charts/fluent-operator/  --set containerRuntime=docker,fluentd.enable=true

Within a couple of minutes, you should observe an index available:

$ curl localhost:9200/_cat/indices
green open ks-logstash-log-2020.04.26 uwQuoO90TwyigqYRW7MDYQ 1 1  99937 0  31.2mb  31.2mb

Success!

Collect audit logs

The Linux audit framework provides a CAPP-compliant (Controlled Access Protection Profile) auditing system that reliably collects information about any security-relevant (or non-security-relevant) event on a system. Refer to manifests/logging-stack/auditd, it supports a method for collecting audit logs from the Linux audit framework.

kubectl apply -f manifests/logging-stack/auditd

# You can change the namespace in manifests/logging-stack/auditd/kustomization.yaml 
# and then use command below to install to another namespace
# kubectl kustomize manifests/logging-stack/auditd/ | kubectl apply -f -

Within a couple of minutes, you should observe an index available:

$ curl localhost:9200/_cat/indices
green open ks-logstash-log-2021.04.06 QeI-k_LoQZ2h1z23F3XiHg  5 1 404879 0 298.4mb 149.2mb

Fluentd

Fluentd acts as a log forward layer that receives logs from Fluent Bit or other Apps through the network.

For more info on various use cases of Fluent Operator Fluentd CRDs, you can refer to Fluent-Operator-Walkthrough.

Plugins

Fluent Bit

Here you can find supported Fluent Bit plugins.

Fluentd

Here you can find supported Fluentd plugins.

Best Practice

Plugin Grouping

Here you can find the plugin group information.

Monitoring

Here you can use the built-in HTTP Server in Fluent Bit.

Custom Parser

Here you can customize parser in Fluent Bit.

Misc

If you want to learn more about Fluent-Operator, please refer to the misc.

Custom Plugin

Here you can learn how to use custom plugin in FluentBit and Fluentd.

Roadmap

Support containerd log format
Add Fluentd CRDs as the log aggregation layer with group name fluentd.fluent.io
Add FluentBit Cluster CRDs with new group name fluentbit.fluent.io
Rename the entire project to Fluent Operator
Support more Fluentd & FluentBit plugins

Development

Requirements

golang v1.16+.requirement
kubectl v1.19.2+.
kubebuilder v3.1+ (the project is build with v3.1.0)
Access to a Kubernetes cluster v1.19.2+

Running

Install CRDs: make install
Run: make run

Contributing

Documentation

API Doc is generated automatically. To modify it, edit the comment above struct fields, then run go run cmd/doc-gen/main.go.

Manifests

Most files under the folder manifests/setup are automatically generated from config. Don't edit them directly, run make manifests instead, then replace these files accordingly.

Community

About the community

Fluent Operator is sponsored and open-sourced by the KubeSphere Team and maintained by the Fluent community.

This project was accepted by the Fluent community as a sub-project in 2021 and is currently a vendor-neutral and community-driven project.

Contact us

You are welcome to join us in the Fluent community to polish it together:

Slack: Create an account in the Fluent Slack workspace and then search #fluent-operator to join or click #fluent-operator to join if you already have an account
Wechat: join the KubeSphere Observability SIG by following the kubesphere WeChat subscription
Bi-weekly Meeting: https://meeting.tencent.com/dm/mZPB9QKdtX0F (You can find the SIG-Observability meeting schedule here)

Videos and blogs

fluent-operator's People

Contributors

Stargazers

Watchers

Forkers

lineuve weizai118 huanggze simonxlh laashub-soa eilinge zp-alwayswin hwchiu lisy09 miaowukong dystudio chenshunliang zhu733756 clix-dev-llc marvel-works estahn dorroddorrod keladhruv charygao deveshk0 misteruly navneet066 feynmanzhou wenchajun seungkyua hadoop835 ekmixon nicktate liangyuanpeng rubinus digitalocean zva90 awcheney nevosial cndoit18 hurricane1988 dkeven lqbing tpiperatgod romain-fluttaz geniussheep azurecloudmonk xuanyingcool franklinharry chiragkyal joshuaphelpsms mario-f felixnoo xxmingming bettygogo2021 baoroushi wangxiaoyang-dev wanjunlei gmarkey loveyang2012 klzsysy dut3062796s jangocheng 7onn isabella232 benjaminhuo jetsquirrel a-bouts fatpa sssissxx frankgreco daikop infra-octave indigostar-kr dgr237 gillbee mangogoforward heph koenekle rdeptula tnpugi jacky68147527 kubesphere forest-l liujie1008cn sgreenberg49 tonyzaizai momoxd007 ganga1980 garfield96 labman4 havardelnan nemcikjan antoniordz96 jarhmj laileman itler michaelpatsula hpapazov dwy12321 ibm-isara dh185221 kristian-zh jiashenghe rothwerx

fluent-operator's Issues

Operator didn't recreate fluent-bit if daemonset was deleted

If fluent-bit daemonset was removed after its initialization, the operator wouldn't recreate it. The operator only react to configure creation and updates.

Input resources cannot specify multiple log paths via the `path` configuration

It seems that multiple paths separated by commas are recognized as one path.

apiVersion: logging.kubesphere.io/v1alpha2
kind: Input
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: >
      {"apiVersion":"logging.kubesphere.io/v1alpha2","kind":"Input","metadata":{"annotations":{},"labels":{"logging.kubesphere.io/component":"logging","logging.kubesphere.io/enabled":"true"},"name":"tail","namespace":"kubesphere-logging-system"},"spec":{"tail":{"db":"/fluent-bit/tail/pos.db","dbSync":"Normal","excludePath":"/var/log/containers/*_kubesphere-logging-system_events-exporter*.log,/var/log/containers/kube-auditing-webhook*_kubesphere-logging-system_kube-auditing-webhook*.log","memBufLimit":"5MB","parser":"docker","path":"/var/log/containers/*.log","refreshIntervalSeconds":10,"skipLongLines":true,"tag":"kube.*"}}}
  labels:
    logging.kubesphere.io/component: logging
    logging.kubesphere.io/enabled: 'true'
  name: tail
  namespace: kubesphere-logging-system
spec:
  tail:
    db: /fluent-bit/tail/pos.db
    dbSync: Normal
    memBufLimit: 5MB
    parser: docker
    path: /var/log/containers/a-*.log,/var/log/containers/b-*.log
    refreshIntervalSeconds: 10
    skipLongLines: true
    tag: kube.*

Helm Chart support

is there any plan to support helm chart for deployment?

How can I add log file path into log record?

Some different log file in my log folder, I wanna know which one log file the log record collected from.

New --watch-namespace flag not supported in current docker image

When adding the args in the docker hub kubesphere/fluentbit-operator image the flag is not supported.
As far as I understand, by default all namespaces are included. Maybe this comment could be included in the README section

Is there any way to keep fluent bit crd modify after kubesphere ClusterConfiguration update?

I installed fluentbit with enable kubesphere logging plugin.
My cluster cri is containerd, not docker. So I need change input CRDs.
But if kubesphere ClusterConfiguration update, the logging plugin will be reinstalled, those CRDs I changed will be overwrite by ks-installer.
Any solution?

Fluent Bit Process doesn't restart automatically if killed

If due to some reason, the fluent bit process is killed internally, it doesn't restart automatically. Ideally, pod should restart if the process dies.

how to create parsers.conf to use in fluent-bit-config secret

I am trying to add below in fluent-bit-config secret to enable the metrics as stated here

[SERVICE]
    HTTP_Server  On
    HTTP_Listen  0.0.0.0
    HTTP_PORT    2020

But not able to do so as there is no configuration provided to add. Please let me know If I am missing anything.

In the Daemonset manifest file, there is already a setting to access it

      containers:
        - name: fluent-bit
          image: 'kubespheredev/fluent-bit:v1.7.3'
          ports:
            - name: metrics
              containerPort: 2020
              protocol: TCP

but it is not actually exposing it.

Helm chart tarball in release

Make a tarball for the Helm chart and add it to the release - then people can do a helm install <URL> directly rather than having to clone the git repo. This can be done with a simple action: https://github.com/helm/chart-releaser-action

An example is here: https://github.com/couchbase-partners/helm-charts/releases/tag/couchbase-operator-2.2.301

helm/helm#9482 is in the works to support helm install direct from a git repo but not ready yet.

OutPut elasticsearch Configuration setting error

My profile

Generated configuration file

How can fluent-operator be consumed as a go module ?

I am trying to consume fluent-operator to allow scheme registration for using go-client to programmatically interface with the fluent-operator CRDs, but it is not possible to go get fluent.io/fluent-operator, it responds with a 404, and so does not implement the go module interface.

Using the github repo url does not work either as the declared module in the go mod is not the same as where it is served:

$ go get github.com/fluent/fluent-operator@master
go: downloading github.com/fluent/fluent-operator v0.4.1-0.20220307074933-9ebb28132f47
go get: github.com/fluent/[email protected]: parsing go.mod:
        module declares its path as: fluent.io/fluent-operator
                but was required as: github.com/fluent/fluent-operator

There is one last possibility, using replace directives, but that should not be used just for the sake of import rewriting:

replace fluent.io/fluent-operator => github.com/fluent/fluent-operator v0.4.1-0.20220307074933-9ebb28132f47

Is there another way to achieve programmatic access to schemes aside from manually re-creating them in my project ?

Thanks

who could upgrade kubesphere/fluent-bit image

fluent bit v1.8.3 has an issue about cpu and RAM, and this issue has been fixed in fluent bit v1.8.11. But the fluent bit version in kubesphere is kubesphere/fluent-bit:v1.8.3

I try to edit https://github.com/fluent/fluentbit-operator/blob/master/cmd/fluent-bit-watcher/Dockerfile ( replace FROM fluent/fluent-bit:1.8.3 with FROM fluent/fluent-bit:1.8.11 ) and build a new image. It works, but I'm not sure the way to call someone upgrade the image kubesphere/fluent-bit version

Add shortNames for FluentBit FluentBitConfig CRDs

I expected to use short names to get the information about fluent-bit and fluent-bit-config CRs, but I found that I had to enter the full name. I think this is relatively inefficient, so I hope to add short names here. For example:

fluent-bit(fb)
fluent-bit-config(fbc)

[root@ht-01 master]# kg -n kubesphere-logging-system fb
error: the server doesn't have a resource type "fb"
[root@ht-01 master]# kg -n kubesphere-logging-system fbc
error: the server doesn't have a resource type "fbc"
[root@ht-01 master]# kg -n kubesphere-logging-system fluentbit
NAME         AGE
fluent-bit   2d22h
[root@ht-01 master]# kg -n kubesphere-logging-system fluentbitconfig
NAME                AGE
fluent-bit-config   2d22h
[root@ht-01 master]#

If you agree, I can do this modification~

[discussion]Do we need to change the domain?

Although the CRD is currently at the namespace level, cluster-level logs and information can be collected. Wouldn't it make sense to add cluster-level CRDS? Because at the user level, usage is indistinguishable. What do we need to change? Domain? Or the name?

Fluentbit-operator doesn't reload configuration

Hello.

I installed fluentbit-operator and it works. When I tried to configure something, change parsing, output, etc.
And I don't understand how it must reload changings.
I tried to restart pods but it doesn't help. Then in two hours I recognized that my new configuration installed.
But I don't understand how it works, how much time I must wait and which parameter I must adjust to reload it more often

Help me please.
Thanks.

Add CI templates for fluentbit-operator

Refer to https://github.com/fluent/fluentd/tree/master/.github

/help
/first-good-issue

fluent-operator process zombie

if fluent-operator process is in zombie status , it can not recover by itself. can not add liveness probe or do something for hearbeat

SSL certs support for Output plugins

Currently We cannot define any secrets reference in output, for some cases a ssl cert or a custom ca cert might be required to access output plugin like kafka, elastic etc. Though this can be achieved currently mounting cert to operator itself but that looses the whole pupose of fluent bit operator where pipelines can be defined dynamically.

Is there any plan to support dynamic secrets for output plugin? A reference implementation can be found here in Prometheus operator

Fluentbit Operator "index" wrong convert Index

Hi, When elasticsearch output "index" is defined, it performs the conversion as "host" inside.
es-output.yaml

kind: Output
metadata:
  name: logtest
  namespace: kubesphere-logging-system
  labels:
    logging.kubesphere.io/enabled: "true"
    logging.kubesphere.io/component: logging
spec:
  match: kube.var.log.containers.*logtest*.log
  es:
    host: elasticsearch-master.logging.svc
    port: 9200
    index: logtest
    logstashFormat: false
    timeKey: "@timestamp"```

result: 
---------------------

[Output]
    Name    es
    Match    kube.var.log.containers.*logtest*.log
    Host    elasticsearch-master.logging.svc
    Port    9200
    Host    logtest
    Logstash_Format    false
    Time_Key    @timestamp

Add more tests for Fluent Bit

function tests
e2e tests

/help

OutPut elasticsearch can not use attribute indexName

Because my index uses life cycle management，So I want the log output to a specific index name, or alias
But the current version does not seem to support the official index_name configuration
index_name or indexName

Refining the helm chart section

Although the helm-chart for fluentbit-operator has now been upgraded to fluent-operator, there are some features that need to be improved. Reference can be made to：https://github.com/fluent/helm-charts
Some parameters need to be configured or customised to suit the situation.

Permission denied error in the setenv container

Hi,

Testing this on a minikube cluster, I do see an error in the setenv container

+ crictl info --output go-template --template '{{.config.containerdRootDir}}'
/bin/sh: crictl: Permission denied
+ echo 'CONTAINER_ROOT_DIR='

minikube was started with:

minikube start -p k8s-test \
  --cpus 4 \
  --memory 6144 \
  --container-runtime=containerd

Any idea how to fix this?

Use k8s master URL instead of `kubernetes.default.svc`

Now the Kubernetes filter used the https://kubernetes.default.svc:443 as the Kube_URL, so the fluent bit pod must have access to service in the default namespace.

We can use the master URL of k8s that get from the kube config file instead of the service to avoid unnecessary authorization.

spec:
  filters:
  - kubernetes:
      annotations: false
      kubeCAFile: /var/run/secrets/kubernetes.io/serviceaccount/ca.crt
      kubeTokenFile: /var/run/secrets/kubernetes.io/serviceaccount/token
      kubeURL: https://lb.kubesphere.local:6443
      labels: false

There will have a DNS resolve error when using the domain, so it needed to mount the /etc/hosts to the fluent bit pod.

  volumes:
    - name: hosts
      hostPath:
        path: /etc/hosts
        type: File

How to add Affinity into daemonsets fluent-bit with helm installed fluentbit

I installed fluentbit with helm in Azure Kubernetes Service, and there is a virtual-node-aci-linux node in the node pools.
Now I need update affinity of daemonsets fluent-bit to make pod fluent-bit not deploy to virtual-node-aci-linux node.
But it rolled back automatically, after I modify the affinity of daemonsets fluent-bit.
Is there a CRD defined the affinity of daemonsets fluent-bit?

level=error err="no such file or directory" when trying to add config files to /fluent-bit/etc

Hey,
I am using the following image kubespheredev/fluent-bit:v1.8.11 and trying to create /etc/fluent-bit/config directory to store config files i gather through sidecar in there (tried creating config files that are not fluent-bit.conf or parsers.conf in there and it doesn't work either)
and use via @INCLUDE method in main fluent-bit config since its not possible to include files that aren't in fluent-bit/etc directory.

Is there something i am missing? how can i add config files that will reload dynamically in kubespheredev/fluent-bit:v1.8.11 image?

Helm chart not uninstalling custom resources

I've been installing the operator using terraform to install using your helm chart and I'm finding some problems running a terraform destroy - it eventually times out because it can't delete the namespace. This seems to be due to the fluentbits custom resource finalizer - if I patch the resource to remove the finalizer, the deletion proceeds as expected.

To take terraform out of the equation, I created the namespace by hand and then ran a helm install, using the same values, followed by helm uninstall - this deleted the operator pod but not the daemonset, nor the fluentbits custom resource. The helm release is deleted, though, so cleanup is to delete the namespace, then patch the fluentbits resource again.

Renaming fluentbit-operator to fluent-operator #189

Plans:

Add more fluentd examples #194
Integrate Fluentd to helm charts #204 #208
Encrypt sensitive information for output plugin #219
Multi-workers in a single fluentd pod #194
More e2e/function tests for generating fb/fd configuration. #203 #206
Enhance docs explanations #199 #228
Push official image like fluent/fluent-operator:xxx, need to rebuild github CI. #213
Refactor multi images/binaries build #214

enhance #189

Error while using regex parser.

I am trying to deploy regex-parser example https://github.com/kubesphere/fluentbit-operator/tree/master/manifests/regex-parser
But i am getting following error

[2021/02/26 12:28:40] [ info] [engine] started (pid=87)
[2021/02/26 12:28:40] [ info] [storage] version=1.0.6, initializing...
[2021/02/26 12:28:40] [ info] [storage] in-memory
[2021/02/26 12:28:40] [ info] [storage] normal synchronization mode, checksum disabled, max_chunks_up=128
[2021/02/26 12:28:40] [error] [sqldb] cannot open database /fluent-bit/tail/pos.db
[2021/02/26 12:28:40] [error] [input:tail:tail.0] could not open/create database
[2021/02/26 12:28:40] [error] [filter:parser:parser.0] requested parser 'my-regex' not found
[2021/02/26 12:28:40] [error] [filter:parser:parser.0] Invalid 'parser'
[2021/02/26 12:28:40] [error] Failed initialize filter parser.0
[2021/02/26 12:28:40] [ info] [input] pausing tail.0
[2021/02/26 12:28:40] [error] [lib] backend failed
level=error msg="Fluent bit exited" error="exit status 255"

imagePullSecrets is not taking the values from values.yml for fluentbit daemonset

Right now imagePullSecrets are not defined in the CRD of the fluentbit https://github.com/kubesphere/fluentbit-operator/blob/master/chart/fluentbit-operator/crds/logging.kubesphere.io_fluentbit.yaml.

Are we planning to add that support?

It was not there for the operator also, I have modified the code and sent a PR for that.

Please let me know if I am missing anything

create crd fluentbit failed when making install

env:
controller-gen --version
Version: v0.2.4
kubernetes: GitVersion:"v1.16.0"
linuxOs: ubuntu18.04
go version: go1.14.1 linux/amd64

git clone https://github.com/kubesphere/fluentbit-operator.git
make install

failed log:
customresourcedefinition.apiextensions.k8s.io/inputs.logging.kubesphere.io configured
customresourcedefinition.apiextensions.k8s.io/outputs.logging.kubesphere.io configured
The CustomResourceDefinition "fluentbits.logging.kubesphere.io" is invalid: status.storedVersions[0]: Invalid value: "v1alpha1": must appear in spec.versions
Makefile:30: recipe for target 'install' failed

The wrong configuration file was generated

Hi guys, I have installed fluent-operator using helm. it installed successfully and also deployed fluentd and fluentbit pods successfully. but I found out that these two pods are reporting errors by checking the logs. The configuration file it produced was different and produced a @48b7c... label under route. But after I delete the two profiles, these are fluentd.yaml and cluster-fluentd-config.yaml .then everything works fine.
Can't a namespaced level configuration file and a cluster level configuration file exist at the same time? If not, we can specify this in the documentation.

Migrating to Fluent Operator

We're planning to add Fluentd support and then rename this project to Fluent Operator
Here are items that need to be done:

Add helm support
Documentation changes
Add FluentBit Cluster CRD such as clusterinput.fluentbit.fluent.io while keeping the original namespace crd like Input.logging.kubesphere.io
Fluentd CRD design & Discussion：The initial proposal
Fluentd CRD & Controller implementation
Integration of FluentBit with Fluentd CRDs
Support containerd log format
Add FluentBit & Fluentd metrics support
Add config validation

Invalid modification of ExcludePath

I use fluent bit on kubesphere. Theoretically, I can determine which logs will be collected by modifying "input.spec.tail.excludepath", but I find it useless. I failed to ask for help in kubesphere forum. This is the kubesphere forum link.

fluent-bit:v1.6.9

Thank you very much for any help

TimeKeep param in plugins/parser/regex_types.go incorrect

https://github.com/fluent/fluentbit-operator/blob/master/api/fluentbitoperator/v1alpha2/plugins/parser/regex_types.go

	if re.TimeKeep != nil {
		kvs.Insert("Time_Format", fmt.Sprint(*re.TimeKeep))
	}

It's incorrect! It is not Time_Format true

I find the time Time_Keep value Time_Keep On from fluent default parsers.conf

Contributing to fluentbit-operator

Hello,

My team and I are working on a Kubernetes distribution named MetalK8s and we're currently working on our log centralization system composed of Fluent Bit and Loki.

Your project seems really interesting for us and instead of developing yet another operator (or forking your repository), we would like to contribute to your project to help you integrate new plugins support such as Loki Output.

First, do you accept contribution?
If yes, do you have guidelines?

Otherwise, we would like to know what motivated your choice for building this operator instead of using already existing things like Logging Operator?
But above all, why basing the log collection only on Fluent Bit rather than the Fluent Bit + Fluentd couple as we can find in most log centralization architecture using Fluent Bit?
On our side, we chose this to have a minimal resources consumption, but is there anything else motivating your choice?
We're still thinking of our implementation choice and it would help us a lot to have your thought.

Thanks,

MetalK8s team.

fluentbit-operator repeat output error log ,if I scale deployment fluentbit-operator up

Image:kubesphere/fluentbit-operator:v0.5.0

I enable kubesphere logging plugin, scale deployment fluentbit-operator up.

pod fluentbit-operator output error log again and again.

2021-10-29T11:08:53.601796493+08:00 2021-10-29T03:08:53.601Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:08:53.601824328+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:08:53.601829554+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:08:53.601834673+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:08:53.601838962+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:08:53.601842656+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:08:53.601846613+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:08:53.601850705+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:08:53.601854441+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:08:53.601857616+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:08:53.601861000+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:08:53.601864990+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:08:53.601868467+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:08:53.601871980+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:08:53.601875945+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:08:54.614504654+08:00 2021-10-29T03:08:54.614Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.615478709+08:00 2021-10-29T03:08:54.615Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.651044432+08:00 2021-10-29T03:08:54.650Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.662744901+08:00 2021-10-29T03:08:54.662Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.672317796+08:00 2021-10-29T03:08:54.672Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.682460075+08:00 2021-10-29T03:08:54.682Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.693638673+08:00 2021-10-29T03:08:54.693Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.703352774+08:00 2021-10-29T03:08:54.703Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.712881918+08:00 2021-10-29T03:08:54.712Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.724627158+08:00 2021-10-29T03:08:54.724Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.734316779+08:00 2021-10-29T03:08:54.734Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.743874863+08:00 2021-10-29T03:08:54.743Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.768467192+08:00 2021-10-29T03:08:54.768Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:54.769327671+08:00 2021-10-29T03:08:54.769Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:55.700213069+08:00 2021-10-29T03:08:55.700Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:55.701765855+08:00 2021-10-29T03:08:55.701Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:55.723385471+08:00 2021-10-29T03:08:55.723Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:08:55.723420089+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:08:55.723426518+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:08:55.723432559+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:08:55.723437942+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:08:55.723441956+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:08:55.723445702+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:08:55.723449337+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:08:55.723455091+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:08:55.723458265+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:08:55.723463119+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:08:55.723467084+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:08:55.723472127+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:08:55.723475618+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:08:55.723479154+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:08:56.735838996+08:00 2021-10-29T03:08:56.735Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.745744124+08:00 2021-10-29T03:08:56.745Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.755860768+08:00 2021-10-29T03:08:56.755Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.766895075+08:00 2021-10-29T03:08:56.766Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.776145624+08:00 2021-10-29T03:08:56.776Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.788926027+08:00 2021-10-29T03:08:56.788Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.799313661+08:00 2021-10-29T03:08:56.799Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.866480808+08:00 2021-10-29T03:08:56.866Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.878128702+08:00 2021-10-29T03:08:56.878Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.889727003+08:00 2021-10-29T03:08:56.889Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.899735574+08:00 2021-10-29T03:08:56.899Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.911051777+08:00 2021-10-29T03:08:56.910Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.958387068+08:00 2021-10-29T03:08:56.957Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.967724523+08:00 2021-10-29T03:08:56.967Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.977630391+08:00 2021-10-29T03:08:56.977Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.988562803+08:00 2021-10-29T03:08:56.988Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:56.997871704+08:00 2021-10-29T03:08:56.997Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:57.008931459+08:00 2021-10-29T03:08:57.008Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:57.018527486+08:00 2021-10-29T03:08:57.018Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:57.057502697+08:00 2021-10-29T03:08:57.057Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:57.812236393+08:00 2021-10-29T03:08:57.812Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:57.822102960+08:00 2021-10-29T03:08:57.821Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:57.838006485+08:00 2021-10-29T03:08:57.837Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:57.838823395+08:00 2021-10-29T03:08:57.838Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:58.836553991+08:00 2021-10-29T03:08:58.836Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:08:58.836578872+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:08:58.836584293+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:08:58.836588370+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:08:58.836594433+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:08:58.836598326+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:08:58.836602857+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:08:58.836606522+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:08:58.836610507+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:08:58.836615598+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:08:58.836619177+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:08:58.836622948+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:08:58.836626416+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:08:58.836629772+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:08:58.836633062+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:08:59.847689553+08:00 2021-10-29T03:08:59.847Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.849153588+08:00 2021-10-29T03:08:59.849Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.898964598+08:00 2021-10-29T03:08:59.898Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.909653382+08:00 2021-10-29T03:08:59.909Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.921345492+08:00 2021-10-29T03:08:59.921Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.930867426+08:00 2021-10-29T03:08:59.930Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.941081751+08:00 2021-10-29T03:08:59.941Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.952868230+08:00 2021-10-29T03:08:59.952Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.962754533+08:00 2021-10-29T03:08:59.962Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.972571416+08:00 2021-10-29T03:08:59.972Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.983679717+08:00 2021-10-29T03:08:59.983Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:08:59.984477282+08:00 2021-10-29T03:08:59.984Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:00.935943764+08:00 2021-10-29T03:09:00.935Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:00.946040715+08:00 2021-10-29T03:09:00.945Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:00.958659681+08:00 2021-10-29T03:09:00.958Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:00.970870282+08:00 2021-10-29T03:09:00.970Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:00.980748737+08:00 2021-10-29T03:09:00.980Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:00.981700313+08:00 2021-10-29T03:09:00.981Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:02.016298958+08:00 2021-10-29T03:09:02.015Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:02.016329164+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:02.016342129+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:02.016350174+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:02.016356582+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:02.016360638+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:02.016363947+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:02.016368195+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:02.016384948+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:02.016389277+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:02.016393401+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:02.016397724+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:02.016408485+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:02.016412185+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:02.016415631+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:03.028903493+08:00 2021-10-29T03:09:03.028Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:03.039233251+08:00 2021-10-29T03:09:03.039Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:03.039254469+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:03.039260025+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:03.039264688+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:03.039268874+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:03.039273680+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:03.039277402+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:03.039281298+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:03.039285235+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:03.039288799+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:03.039292344+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:03.039296625+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:03.039299723+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:03.039303574+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:03.039308342+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:04.055598074+08:00 2021-10-29T03:09:04.050Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:04.061925409+08:00 2021-10-29T03:09:04.061Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:04.072862708+08:00 2021-10-29T03:09:04.072Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:04.084320798+08:00 2021-10-29T03:09:04.084Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:04.085420903+08:00 2021-10-29T03:09:04.085Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:05.115867764+08:00 2021-10-29T03:09:05.115Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:05.128668150+08:00 2021-10-29T03:09:05.128Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:05.128694346+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:05.128721018+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:05.128726743+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:05.128732561+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:05.128736490+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:05.128740314+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:05.128744327+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:05.128750367+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:05.128753890+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:05.128758210+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:05.128762225+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:05.128771002+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:05.128774466+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:05.128777768+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:06.141610890+08:00 2021-10-29T03:09:06.141Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:06.142485236+08:00 2021-10-29T03:09:06.142Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:06.184626886+08:00 2021-10-29T03:09:06.184Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:06.195851007+08:00 2021-10-29T03:09:06.195Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:06.196724242+08:00 2021-10-29T03:09:06.196Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:07.219494038+08:00 2021-10-29T03:09:07.219Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:07.231308794+08:00 2021-10-29T03:09:07.231Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:07.240901932+08:00 2021-10-29T03:09:07.240Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:07.252022508+08:00 2021-10-29T03:09:07.251Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:07.263451985+08:00 2021-10-29T03:09:07.263Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:07.272782204+08:00 2021-10-29T03:09:07.272Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:07.284642127+08:00 2021-10-29T03:09:07.284Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:07.291946413+08:00 2021-10-29T03:09:07.291Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:08.242323290+08:00 2021-10-29T03:09:08.242Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:08.256305410+08:00 2021-10-29T03:09:08.254Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:08.283945394+08:00 2021-10-29T03:09:08.283Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:08.298606386+08:00 2021-10-29T03:09:08.295Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:08.306039848+08:00 2021-10-29T03:09:08.305Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:08.316873346+08:00 2021-10-29T03:09:08.316Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:08.328499220+08:00 2021-10-29T03:09:08.328Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:08.329364378+08:00 2021-10-29T03:09:08.329Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:09.310265894+08:00 2021-10-29T03:09:09.310Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:09.326100184+08:00 2021-10-29T03:09:09.325Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:09.336032997+08:00 2021-10-29T03:09:09.335Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:09.369141508+08:00 2021-10-29T03:09:09.369Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:09.379688107+08:00 2021-10-29T03:09:09.379Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:09.389460077+08:00 2021-10-29T03:09:09.389Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:09.416631634+08:00 2021-10-29T03:09:09.416Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:09.426272706+08:00 2021-10-29T03:09:09.426Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:09.457909567+08:00 2021-10-29T03:09:09.457Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:09.459197872+08:00 2021-10-29T03:09:09.459Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:10.335934041+08:00 2021-10-29T03:09:10.335Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:10.337132664+08:00 2021-10-29T03:09:10.337Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:11.391310544+08:00 2021-10-29T03:09:11.391Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:11.401585079+08:00 2021-10-29T03:09:11.401Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:11.401607664+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:11.401613223+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:11.401617688+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:11.401622404+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:11.401627232+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:11.401631770+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:11.401635492+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:11.401639612+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:11.401642794+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:11.401646663+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:11.401651838+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:11.401656606+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:11.401661334+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:11.401664780+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:12.412578765+08:00 2021-10-29T03:09:12.412Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:12.424816047+08:00 2021-10-29T03:09:12.424Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:12.424850300+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:12.424856864+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:12.424862475+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:12.424868497+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:12.424872985+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:12.424876658+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:12.424881599+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:12.424887355+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:12.424890538+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:12.424896728+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:12.424900303+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:12.424904533+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:12.424908058+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:12.424911761+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:13.437740344+08:00 2021-10-29T03:09:13.437Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:13.451129796+08:00 2021-10-29T03:09:13.450Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:13.471711310+08:00 2021-10-29T03:09:13.471Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:13.487721350+08:00 2021-10-29T03:09:13.487Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:13.500624766+08:00 2021-10-29T03:09:13.500Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:13.516797108+08:00 2021-10-29T03:09:13.516Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:13.527116601+08:00 2021-10-29T03:09:13.527Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:13.537769066+08:00 2021-10-29T03:09:13.537Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:13.557496975+08:00 2021-10-29T03:09:13.557Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:13.559249974+08:00 2021-10-29T03:09:13.559Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:14.522835572+08:00 2021-10-29T03:09:14.522Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:14.533464754+08:00 2021-10-29T03:09:14.533Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:14.533527677+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:14.533533671+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:14.533538007+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:14.533548072+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:14.533551932+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:14.533555200+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:14.533558918+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:14.533562779+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:14.533565885+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:14.533569571+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:14.533575149+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:14.533578739+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:14.533582116+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:14.533587377+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:15.547042153+08:00 2021-10-29T03:09:15.546Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:15.557523648+08:00 2021-10-29T03:09:15.557Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:15.558423514+08:00 2021-10-29T03:09:15.558Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:15.604372858+08:00 2021-10-29T03:09:15.604Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:15.604394624+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:15.604406872+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:15.604412290+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:15.604422491+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:15.604426888+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:15.604430451+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:15.604434494+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:15.604438259+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:15.604441519+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:15.604444956+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:15.604458009+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:15.604461500+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:15.604465222+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:15.604468622+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:16.615578710+08:00 2021-10-29T03:09:16.615Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:16.627658917+08:00 2021-10-29T03:09:16.627Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:16.627682784+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:16.627688258+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:16.627705526+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:16.627710135+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:16.627713771+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:16.627717593+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:16.627722140+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:16.627729047+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:16.627732876+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:16.627736709+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:16.627740253+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:16.627746340+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:16.627749766+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:16.627753209+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:17.643379363+08:00 2021-10-29T03:09:17.643Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.644234201+08:00 2021-10-29T03:09:17.644Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.758443646+08:00 2021-10-29T03:09:17.758Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.770575735+08:00 2021-10-29T03:09:17.770Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.781159496+08:00 2021-10-29T03:09:17.781Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.791701277+08:00 2021-10-29T03:09:17.791Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.803423078+08:00 2021-10-29T03:09:17.803Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.813300639+08:00 2021-10-29T03:09:17.813Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.867255291+08:00 2021-10-29T03:09:17.867Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.878712200+08:00 2021-10-29T03:09:17.878Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.890277272+08:00 2021-10-29T03:09:17.890Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.900150329+08:00 2021-10-29T03:09:17.900Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.911721415+08:00 2021-10-29T03:09:17.911Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.922064133+08:00 2021-10-29T03:09:17.921Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.931640821+08:00 2021-10-29T03:09:17.931Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.971613356+08:00 2021-10-29T03:09:17.971Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.981248439+08:00 2021-10-29T03:09:17.981Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:17.991040869+08:00 2021-10-29T03:09:17.990Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:18.001397023+08:00 2021-10-29T03:09:18.001Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:18.002209249+08:00 2021-10-29T03:09:18.002Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:18.823372034+08:00 2021-10-29T03:09:18.823Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:18.823397831+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:18.823415419+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:18.823420049+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:18.823424434+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:18.823428355+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:18.823431653+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:18.823443203+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:18.823448001+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:18.823451887+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:18.823460245+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:18.823464543+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:18.823467949+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:18.823471394+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:18.823474681+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:19.834368956+08:00 2021-10-29T03:09:19.834Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:19.853241289+08:00 2021-10-29T03:09:19.852Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:19.863907991+08:00 2021-10-29T03:09:19.863Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:19.874460130+08:00 2021-10-29T03:09:19.874Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:19.886616678+08:00 2021-10-29T03:09:19.886Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:19.896222266+08:00 2021-10-29T03:09:19.896Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:19.909374282+08:00 2021-10-29T03:09:19.909Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:19.922522616+08:00 2021-10-29T03:09:19.922Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:19.923593014+08:00 2021-10-29T03:09:19.923Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:20.897808250+08:00 2021-10-29T03:09:20.897Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:20.908180168+08:00 2021-10-29T03:09:20.908Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:20.908203038+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:20.908208565+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:20.908212658+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:20.908217179+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:20.908220923+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:20.908238030+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:20.908241945+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:20.908246184+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:20.908249836+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:20.908254049+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:20.908257895+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:20.908261490+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:20.908264878+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:20.908268124+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:21.919114979+08:00 2021-10-29T03:09:21.918Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:21.938686431+08:00 2021-10-29T03:09:21.938Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:21.938712970+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:21.938719208+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:21.938723892+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:21.938728231+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:21.938732698+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:21.938736044+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:21.938739939+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:21.938746280+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:21.938749879+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:21.938753868+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:21.938757779+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:21.938761370+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:21.938765085+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:21.938768507+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:22.950950266+08:00 2021-10-29T03:09:22.950Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:22.962098435+08:00 2021-10-29T03:09:22.961Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:23.057286219+08:00 2021-10-29T03:09:22.981Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:23.069860987+08:00 2021-10-29T03:09:23.069Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:23.070690759+08:00 2021-10-29T03:09:23.070Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:24.004707640+08:00 2021-10-29T03:09:24.004Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:24.004736275+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:24.004742185+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:24.004746805+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:24.004751347+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:24.004754902+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:24.004759556+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:24.004763962+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:24.004768913+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:24.004772418+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:24.004776193+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:24.004779851+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:24.004783059+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:24.004786226+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:24.004789283+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:25.025852012+08:00 2021-10-29T03:09:25.025Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:25.035559109+08:00 2021-10-29T03:09:25.035Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:25.035582429+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:25.035588483+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:25.035593924+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:25.035600860+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:25.035604588+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:25.035607872+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:25.035611429+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:25.035617293+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:25.035620543+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:25.035624776+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:25.035631223+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:25.035649820+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:25.035652978+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:25.035656275+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:26.047994689+08:00 2021-10-29T03:09:26.047Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:26.048970234+08:00 2021-10-29T03:09:26.048Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:26.068046657+08:00 2021-10-29T03:09:26.067Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:26.069310593+08:00 2021-10-29T03:09:26.069Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:27.093687287+08:00 2021-10-29T03:09:27.093Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:27.094745890+08:00 2021-10-29T03:09:27.094Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:27.103655918+08:00 2021-10-29T03:09:27.103Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:27.123288570+08:00 2021-10-29T03:09:27.123Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:27.133492382+08:00 2021-10-29T03:09:27.133Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:27.134798226+08:00 2021-10-29T03:09:27.134Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:28.151993117+08:00 2021-10-29T03:09:28.151Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:28.162908367+08:00 2021-10-29T03:09:28.162Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:28.174336254+08:00 2021-10-29T03:09:28.174Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:28.184993844+08:00 2021-10-29T03:09:28.184Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:28.196558904+08:00 2021-10-29T03:09:28.196Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:28.206300534+08:00 2021-10-29T03:09:28.206Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:28.216095680+08:00 2021-10-29T03:09:28.216Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:28.227084572+08:00 2021-10-29T03:09:28.227Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:28.227945759+08:00 2021-10-29T03:09:28.227Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:29.179013438+08:00 2021-10-29T03:09:29.178Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:29.179042448+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:29.179053518+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:29.179057977+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:29.179062831+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:29.179066679+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:29.179070158+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:29.179074000+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:29.179077966+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:29.179081444+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:29.179085124+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:29.179089466+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:29.179092959+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:29.179096394+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:29.179099518+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:30.190732428+08:00 2021-10-29T03:09:30.190Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.204213351+08:00 2021-10-29T03:09:30.204Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.214947943+08:00 2021-10-29T03:09:30.214Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.225150470+08:00 2021-10-29T03:09:30.225Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.236615614+08:00 2021-10-29T03:09:30.236Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.247051613+08:00 2021-10-29T03:09:30.246Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.271720195+08:00 2021-10-29T03:09:30.271Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.282302733+08:00 2021-10-29T03:09:30.282Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.382215181+08:00 2021-10-29T03:09:30.382Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.393719379+08:00 2021-10-29T03:09:30.393Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.403638401+08:00 2021-10-29T03:09:30.403Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:30.404973698+08:00 2021-10-29T03:09:30.404Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:31.230381376+08:00 2021-10-29T03:09:31.230Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:31.240417420+08:00 2021-10-29T03:09:31.240Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:31.250959531+08:00 2021-10-29T03:09:31.250Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:31.262441405+08:00 2021-10-29T03:09:31.262Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:31.278654690+08:00 2021-10-29T03:09:31.278Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:31.290214922+08:00 2021-10-29T03:09:31.290Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:31.301346440+08:00 2021-10-29T03:09:31.301Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:31.311235960+08:00 2021-10-29T03:09:31.311Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:31.322666018+08:00 2021-10-29T03:09:31.322Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:31.323489532+08:00 2021-10-29T03:09:31.323Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:32.264870376+08:00 2021-10-29T03:09:32.264Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:32.286785921+08:00 2021-10-29T03:09:32.286Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:32.299064428+08:00 2021-10-29T03:09:32.298Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:32.309191439+08:00 2021-10-29T03:09:32.309Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:32.310321428+08:00 2021-10-29T03:09:32.310Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:33.291497871+08:00 2021-10-29T03:09:33.291Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:33.306080658+08:00 2021-10-29T03:09:33.305Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:33.306122834+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:33.306128849+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:33.306135257+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:33.306139940+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:33.306144783+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:33.306148475+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:33.306152776+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:33.306156740+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:33.306184527+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:33.306189454+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:33.306193350+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:33.306196569+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:33.306200008+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:33.306203327+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:34.318392135+08:00 2021-10-29T03:09:34.318Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:34.328568195+08:00 2021-10-29T03:09:34.328Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:34.339213749+08:00 2021-10-29T03:09:34.339Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:34.350803745+08:00 2021-10-29T03:09:34.350Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:34.360585705+08:00 2021-10-29T03:09:34.360Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:34.372896757+08:00 2021-10-29T03:09:34.372Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:34.382664040+08:00 2021-10-29T03:09:34.382Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:34.392351917+08:00 2021-10-29T03:09:34.392Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:34.393553055+08:00 2021-10-29T03:09:34.393Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:35.363991673+08:00 2021-10-29T03:09:35.362Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:35.364028684+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:35.364035470+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:35.364040062+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:35.364044202+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:35.364048094+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:35.364051679+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:35.364055203+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:35.364059214+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:35.364062375+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:35.364066484+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:35.364070162+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:35.364073858+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:35.364077620+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:35.364080746+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:36.374202842+08:00 2021-10-29T03:09:36.374Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.384374661+08:00 2021-10-29T03:09:36.384Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.459956626+08:00 2021-10-29T03:09:36.459Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.471874365+08:00 2021-10-29T03:09:36.471Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.486204160+08:00 2021-10-29T03:09:36.486Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.496399078+08:00 2021-10-29T03:09:36.496Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.511324836+08:00 2021-10-29T03:09:36.511Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.557561790+08:00 2021-10-29T03:09:36.557Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.569006427+08:00 2021-10-29T03:09:36.568Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.583294692+08:00 2021-10-29T03:09:36.583Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.597319701+08:00 2021-10-29T03:09:36.597Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:36.598759731+08:00 2021-10-29T03:09:36.598Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:37.411102525+08:00 2021-10-29T03:09:37.410Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:37.422840317+08:00 2021-10-29T03:09:37.422Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:37.422859721+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:37.422865330+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:37.422869790+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:37.422874488+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:37.422878097+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:37.422881696+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:37.422885197+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:37.422891427+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:37.422896866+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:37.422901220+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:37.422904717+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:37.422908399+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:37.422911910+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:37.422915614+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:38.435811612+08:00 2021-10-29T03:09:38.435Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.447009493+08:00 2021-10-29T03:09:38.446Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.457156972+08:00 2021-10-29T03:09:38.457Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.469843625+08:00 2021-10-29T03:09:38.469Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.479733964+08:00 2021-10-29T03:09:38.479Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.492903953+08:00 2021-10-29T03:09:38.492Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.503729521+08:00 2021-10-29T03:09:38.503Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.513970011+08:00 2021-10-29T03:09:38.513Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.525515689+08:00 2021-10-29T03:09:38.525Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.557782510+08:00 2021-10-29T03:09:38.557Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.568969514+08:00 2021-10-29T03:09:38.568Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.581427186+08:00 2021-10-29T03:09:38.581Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.591914078+08:00 2021-10-29T03:09:38.591Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.602116538+08:00 2021-10-29T03:09:38.602Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:38.602935634+08:00 2021-10-29T03:09:38.602Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:39.472616501+08:00 2021-10-29T03:09:39.472Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:39.483532246+08:00 2021-10-29T03:09:39.483Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:39.494798104+08:00 2021-10-29T03:09:39.494Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:39.505378775+08:00 2021-10-29T03:09:39.505Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:39.518076893+08:00 2021-10-29T03:09:39.517Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:39.518923120+08:00 2021-10-29T03:09:39.518Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:40.497005701+08:00 2021-10-29T03:09:40.496Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:40.497036033+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:40.497041750+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:40.497059823+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:40.497065174+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:40.497068978+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:40.497072378+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:40.497076203+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:40.497080507+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:40.497083621+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:40.497087419+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:40.497091462+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:40.497094910+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:40.497098953+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:40.497102368+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:41.509456856+08:00 2021-10-29T03:09:41.509Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:41.513795481+08:00 2021-10-29T03:09:41.513Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:41.558021226+08:00 2021-10-29T03:09:41.557Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:41.558076349+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:41.558081672+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:41.558086236+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:41.558091062+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:41.558094646+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:41.558125897+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:41.558130375+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:41.558134559+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:41.558138076+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:41.558141712+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:41.558145744+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:41.558149283+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:41.558152735+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:41.558156271+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:42.570662886+08:00 2021-10-29T03:09:42.570Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:42.582278939+08:00 2021-10-29T03:09:42.581Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:42.592602979+08:00 2021-10-29T03:09:42.592Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:42.603945463+08:00 2021-10-29T03:09:42.603Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:42.614126887+08:00 2021-10-29T03:09:42.614Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:42.623869572+08:00 2021-10-29T03:09:42.623Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:42.625117858+08:00 2021-10-29T03:09:42.625Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:43.607788759+08:00 2021-10-29T03:09:43.607Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:43.607817381+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:43.607824048+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:43.607829690+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:43.607843630+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:43.607847569+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:43.607850888+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:43.607855816+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:43.607862435+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:43.607866248+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:43.607870952+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:43.607874994+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:43.607878437+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:43.607881276+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:43.607884425+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:44.618589875+08:00 2021-10-29T03:09:44.618Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:44.621025596+08:00 2021-10-29T03:09:44.620Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:44.640991325+08:00 2021-10-29T03:09:44.640Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:44.641022838+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:44.641028740+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:44.641033459+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:44.641037952+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:44.641041577+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:44.641044737+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:44.641048495+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:44.641052368+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:44.641055789+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:44.641059556+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:44.641063308+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:44.641066825+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:44.641070153+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:44.641073639+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:45.653366877+08:00 2021-10-29T03:09:45.653Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:45.664041582+08:00 2021-10-29T03:09:45.663Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:45.675057592+08:00 2021-10-29T03:09:45.674Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:45.688035727+08:00 2021-10-29T03:09:45.687Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:45.698421015+08:00 2021-10-29T03:09:45.698Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:45.710435088+08:00 2021-10-29T03:09:45.710Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:45.720754224+08:00 2021-10-29T03:09:45.720Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:45.730749900+08:00 2021-10-29T03:09:45.730Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:45.768382116+08:00 2021-10-29T03:09:45.768Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:45.780566041+08:00 2021-10-29T03:09:45.780Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:45.782678478+08:00 2021-10-29T03:09:45.782Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:46.689560436+08:00 2021-10-29T03:09:46.689Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:46.689603181+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:46.689610364+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:46.689615790+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:46.689621240+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:46.689624693+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:46.689628377+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:46.689632508+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:46.689638117+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:46.689641621+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:46.689645665+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:46.689649205+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:46.689653023+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:46.689656431+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:46.689659967+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:47.702221178+08:00 2021-10-29T03:09:47.702Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:47.713758178+08:00 2021-10-29T03:09:47.713Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:47.729680050+08:00 2021-10-29T03:09:47.729Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:47.730515167+08:00 2021-10-29T03:09:47.730Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:48.739551411+08:00 2021-10-29T03:09:48.739Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:48.740473177+08:00 2021-10-29T03:09:48.740Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:49.763192362+08:00 2021-10-29T03:09:49.762Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:49.763222577+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:49.763228768+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:49.763233446+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:49.763685132+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:49.763707248+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:49.763711185+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:49.763715169+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:49.763718953+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:49.763722697+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:49.763726890+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:49.763731314+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:49.763737079+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:49.763740602+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:49.763744886+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:50.776827946+08:00 2021-10-29T03:09:50.776Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:50.793523365+08:00 2021-10-29T03:09:50.793Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:50.793552826+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:50.793558046+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:50.793562504+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:50.793567182+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:50.793570607+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:50.793574332+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:50.793579229+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:50.793583270+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:50.793586956+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:50.793591470+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:50.793595733+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:50.793599225+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:50.793602759+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:50.793606258+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:51.806965653+08:00 2021-10-29T03:09:51.806Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:51.874039537+08:00 2021-10-29T03:09:51.873Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:51.883987044+08:00 2021-10-29T03:09:51.883Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:51.884019800+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:51.884029302+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:51.884035624+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:51.884040036+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:51.884043761+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:51.884047207+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:51.884051112+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:51.884055029+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:51.884058545+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:51.884062039+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:51.884066017+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:51.884069686+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:51.884073556+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:51.884076970+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:52.895350998+08:00 2021-10-29T03:09:52.895Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:52.907531228+08:00 2021-10-29T03:09:52.907Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:52.907559175+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:52.907566562+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:52.907572153+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:52.907580290+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:52.907584881+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:52.907597786+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:52.907602826+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:52.907608969+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:52.907612285+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:52.907616965+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:52.907620754+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:52.907624363+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:52.907627791+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:52.907631444+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:53.920107180+08:00 2021-10-29T03:09:53.920Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:53.921019911+08:00 2021-10-29T03:09:53.920Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:53.939517206+08:00 2021-10-29T03:09:53.939Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:53.949330757+08:00 2021-10-29T03:09:53.949Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:53.959250739+08:00 2021-10-29T03:09:53.959Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:53.971455646+08:00 2021-10-29T03:09:53.971Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:53.974940110+08:00 2021-10-29T03:09:53.974Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:54.963855624+08:00 2021-10-29T03:09:54.963Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:54.974980895+08:00 2021-10-29T03:09:54.974Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:54.974999728+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:54.975005361+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:54.975009417+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:54.975013998+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:54.975017688+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:54.975021170+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:54.975045938+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:54.975050363+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:54.975053789+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:54.975057734+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:54.975061646+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:54.975064886+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:54.975068241+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:54.975071315+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:55.986026449+08:00 2021-10-29T03:09:55.985Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:55.999197227+08:00 2021-10-29T03:09:55.999Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:55.999227168+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:55.999232635+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:55.999237309+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:55.999241755+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:55.999255627+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:55.999259666+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:55.999263378+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:55.999267870+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:55.999271192+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:55.999275135+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:55.999278930+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:55.999282669+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:55.999286117+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:55.999290084+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:57.015744408+08:00 2021-10-29T03:09:57.015Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:57.032660523+08:00 2021-10-29T03:09:57.032Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:57.032683723+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:57.032715189+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:57.032720812+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:57.032725187+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:57.032729469+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:57.032732941+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:57.032737627+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:57.032741483+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:57.032744948+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:57.032748822+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:57.032752528+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:57.032755680+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:57.032786807+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:57.032793460+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:58.045495208+08:00 2021-10-29T03:09:58.045Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:58.056579778+08:00 2021-10-29T03:09:58.056Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:09:58.056600908+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:09:58.056606633+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:09:58.056610976+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:09:58.056615255+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:09:58.056619002+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:09:58.056622667+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:09:58.056626733+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:09:58.056640815+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:09:58.056645506+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:09:58.056649824+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:09:58.056653290+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:09:58.056656807+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:09:58.056660546+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:09:58.056666577+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:09:59.069526724+08:00 2021-10-29T03:09:59.069Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:59.070557377+08:00 2021-10-29T03:09:59.070Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:59.089191241+08:00 2021-10-29T03:09:59.089Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:59.098918491+08:00 2021-10-29T03:09:59.098Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:59.108985495+08:00 2021-10-29T03:09:59.108Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:59.119140914+08:00 2021-10-29T03:09:59.119Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:59.130486134+08:00 2021-10-29T03:09:59.130Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:59.140196062+08:00 2021-10-29T03:09:59.140Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:09:59.141024798+08:00 2021-10-29T03:09:59.140Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:00.115879484+08:00 2021-10-29T03:10:00.115Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:00.126364775+08:00 2021-10-29T03:10:00.126Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:10:00.126388236+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:10:00.126395697+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:10:00.126408336+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:10:00.126413441+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:10:00.126416845+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:10:00.126420764+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:10:00.126424822+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:10:00.126429318+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:10:00.126432604+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:10:00.126436291+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:10:00.126440191+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:10:00.126443419+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:10:00.126446818+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:10:00.126449984+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:10:01.139103813+08:00 2021-10-29T03:10:01.139Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:01.149245490+08:00 2021-10-29T03:10:01.149Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:01.161763601+08:00 2021-10-29T03:10:01.161Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:01.171277180+08:00 2021-10-29T03:10:01.171Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:01.182685800+08:00 2021-10-29T03:10:01.182Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:01.183634919+08:00 2021-10-29T03:10:01.183Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.176338156+08:00 2021-10-29T03:10:02.176Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.190538747+08:00 2021-10-29T03:10:02.190Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.200355560+08:00 2021-10-29T03:10:02.200Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.212355934+08:00 2021-10-29T03:10:02.212Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.222122092+08:00 2021-10-29T03:10:02.222Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.231590276+08:00 2021-10-29T03:10:02.231Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.245606900+08:00 2021-10-29T03:10:02.245Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.267896508+08:00 2021-10-29T03:10:02.267Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.280393618+08:00 2021-10-29T03:10:02.280Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.291427349+08:00 2021-10-29T03:10:02.291Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.301074798+08:00 2021-10-29T03:10:02.300Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.310813079+08:00 2021-10-29T03:10:02.310Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.321892630+08:00 2021-10-29T03:10:02.321Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.357565197+08:00 2021-10-29T03:10:02.357Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:02.374591110+08:00 2021-10-29T03:10:02.374Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:03.209231261+08:00 2021-10-29T03:10:03.209Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:03.220327301+08:00 2021-10-29T03:10:03.220Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:10:03.220360680+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:10:03.220366647+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:10:03.220371653+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:10:03.220376383+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:10:03.220380065+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:10:03.220383669+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:10:03.220387499+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:10:03.220415766+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:10:03.220421171+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:10:03.220426643+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:10:03.220430666+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:10:03.220434389+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:10:03.220437990+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:10:03.220441737+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:10:04.255748438+08:00 2021-10-29T03:10:04.255Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.267206424+08:00 2021-10-29T03:10:04.267Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.279951290+08:00 2021-10-29T03:10:04.279Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.289541404+08:00 2021-10-29T03:10:04.289Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.301314226+08:00 2021-10-29T03:10:04.301Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.311422253+08:00 2021-10-29T03:10:04.311Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.320932385+08:00 2021-10-29T03:10:04.320Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.332384771+08:00 2021-10-29T03:10:04.332Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.341968097+08:00 2021-10-29T03:10:04.341Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.354925312+08:00 2021-10-29T03:10:04.354Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.373515595+08:00 2021-10-29T03:10:04.373Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.458058784+08:00 2021-10-29T03:10:04.457Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.470552982+08:00 2021-10-29T03:10:04.470Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:04.471867312+08:00 2021-10-29T03:10:04.471Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:05.311104522+08:00 2021-10-29T03:10:05.310Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:05.322058808+08:00 2021-10-29T03:10:05.321Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:05.323334005+08:00 2021-10-29T03:10:05.323Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:06.399811867+08:00 2021-10-29T03:10:06.399Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:10:06.399836526+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:10:06.399841801+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:10:06.399846343+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:10:06.399851141+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:10:06.399854844+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:10:06.399858321+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:10:06.399862548+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:10:06.399866541+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:10:06.399870121+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:10:06.399873750+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:10:06.399877789+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:10:06.399881499+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:10:06.399885526+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:10:06.399888990+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:10:07.411125485+08:00 2021-10-29T03:10:07.410Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:07.423295923+08:00 2021-10-29T03:10:07.423Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:10:07.423319393+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:10:07.423324609+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:10:07.423328846+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:10:07.423334812+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:10:07.423338343+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:10:07.423342035+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:10:07.423348194+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:10:07.423354189+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:10:07.423357926+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:10:07.423373311+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:10:07.423377035+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:10:07.423380560+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:10:07.423383999+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:10:07.423387187+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:10:08.436369802+08:00 2021-10-29T03:10:08.436Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:08.446810103+08:00 2021-10-29T03:10:08.446Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:08.457522810+08:00 2021-10-29T03:10:08.457Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:08.458691829+08:00 2021-10-29T03:10:08.458Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:09.519246826+08:00 2021-10-29T03:10:09.519Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:10:09.519270572+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:10:09.519275969+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:10:09.519281217+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:10:09.519293469+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:10:09.519297130+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:10:09.519300934+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:10:09.519304408+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:10:09.519310749+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:10:09.519313748+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:10:09.519317643+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:10:09.519321172+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:10:09.519324943+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:10:09.519328905+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:10:09.519332828+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:10:10.534465647+08:00 2021-10-29T03:10:10.534Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:10.551543791+08:00 2021-10-29T03:10:10.551Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:10.562436499+08:00 2021-10-29T03:10:10.562Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:10.583093275+08:00 2021-10-29T03:10:10.583Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:10.584599549+08:00 2021-10-29T03:10:10.584Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:11.589752009+08:00 2021-10-29T03:10:11.589Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:10:11.589780050+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:10:11.589786044+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:10:11.589801668+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:10:11.589806752+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:10:11.589810647+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:10:11.589814394+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:10:11.589818099+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:10:11.589822353+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:10:11.589826159+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:10:11.589830234+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:10:11.589834060+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:10:11.589837621+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:10:11.589840831+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:10:11.589844315+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:10:12.601055404+08:00 2021-10-29T03:10:12.600Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:12.613334853+08:00 2021-10-29T03:10:12.613Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:12.623469686+08:00 2021-10-29T03:10:12.623Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:12.633056909+08:00 2021-10-29T03:10:12.632Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:12.645018530+08:00 2021-10-29T03:10:12.644Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:12.654878506+08:00 2021-10-29T03:10:12.654Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:12.656017835+08:00 2021-10-29T03:10:12.655Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:13.635996850+08:00 2021-10-29T03:10:13.635Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:13.637107764+08:00 2021-10-29T03:10:13.637Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:13.657181340+08:00 2021-10-29T03:10:13.657Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:13.668416103+08:00 2021-10-29T03:10:13.668Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:13.678901883+08:00 2021-10-29T03:10:13.678Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:13.691903442+08:00 2021-10-29T03:10:13.691Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:13.692861417+08:00 2021-10-29T03:10:13.692Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:14.682748623+08:00 2021-10-29T03:10:14.682Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:10:14.682765701+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:10:14.682770732+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:10:14.682774993+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:10:14.682779110+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:10:14.682782998+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:10:14.682786556+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:10:14.682790551+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:10:14.682794265+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:10:14.682797609+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:10:14.682801788+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:10:14.682805446+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:10:14.682809246+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:10:14.682812511+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:10:14.682815836+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:10:15.694847830+08:00 2021-10-29T03:10:15.694Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:15.707452670+08:00 2021-10-29T03:10:15.707Z ERROR controller-runtime.controller Reconciler error {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config", "error": "Operation cannot be fulfilled on secrets \"fluent-bit-config\": the object has been modified; please apply your changes to the latest version and try again"}

2021-10-29T11:10:15.707479168+08:00 github.com/go-logr/zapr.(*zapLogger).Error

2021-10-29T11:10:15.707484556+08:00 /go/pkg/mod/github.com/go-logr/[email protected]/zapr.go:128

2021-10-29T11:10:15.707506865+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler

2021-10-29T11:10:15.707511560+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:258

2021-10-29T11:10:15.707515342+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem

2021-10-29T11:10:15.707519062+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:232

2021-10-29T11:10:15.707522786+08:00 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker

2021-10-29T11:10:15.707526855+08:00 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:211

2021-10-29T11:10:15.707530179+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1

2021-10-29T11:10:15.707534219+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:152

2021-10-29T11:10:15.707538297+08:00 k8s.io/apimachinery/pkg/util/wait.JitterUntil

2021-10-29T11:10:15.707542140+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:153

2021-10-29T11:10:15.707545348+08:00 k8s.io/apimachinery/pkg/util/wait.Until

2021-10-29T11:10:15.707548972+08:00 /go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/wait.go:88

2021-10-29T11:10:16.721519223+08:00 2021-10-29T03:10:16.721Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:16.731606150+08:00 2021-10-29T03:10:16.731Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:16.741452316+08:00 2021-10-29T03:10:16.741Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:16.752981049+08:00 2021-10-29T03:10:16.752Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:16.768145054+08:00 2021-10-29T03:10:16.768Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:16.784207576+08:00 2021-10-29T03:10:16.784Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:16.796374875+08:00 2021-10-29T03:10:16.796Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

2021-10-29T11:10:16.797676350+08:00 2021-10-29T03:10:16.797Z DEBUG controller-runtime.controller Successfully Reconciled {"controller": "fluentbitconfig", "request": "kubesphere-logging-system/fluent-bit-config"}

kafka output not support dynamic_topic configuration

fluentbit supports Dynamic_Topic starting with version 1.5, but I can find this configuration key in API Doc

How to set up multi-line log collection similar to java

How to set up multi-line log collection similar to java
I can't find any examples

Parser error

Hello!
I try to configure FluentBit-operator and I have an error:

[error] [input:tail:tail.0] parser 'docker' is not registered

What I don't understand in configuration?

My configuration is (in secret fluent-bit-config):
fluent-bit.conf:

[Service]
Http_Listen 0.0.0.0
Http_Port 2020
Http_Server true
[Input]
Name tail
Path /var/log/containers/.log
Refresh_Interval 10
Skip_Long_Lines true
DB /fluent-bit/tail/pos.db
DB.Sync Normal
Mem_Buf_Limit 5MB
Parser docker
Tag kube.
[Filter]
Name kubernetes
Match kube.*
Kube_URL https://kubernetes.default.svc:443
Kube_CA_File /var/run/secrets/kubernetes.io/serviceaccount/ca.crt
Kube_Token_File /var/run/secrets/kubernetes.io/serviceaccount/token
Labels false
Annotations false
[Filter]
Name nest
Match kube.*
Operation lift
Nested_under kubernetes
Add_prefix kubernetes_
[Filter]
Name modify
Match kube.*
Remove stream
Remove kubernetes_pod_id
Remove kubernetes_host
Remove kubernetes_container_hash
Add productID TST.000
Add tenantID FBO
Rename log message
[Filter]
Name nest
Match kube.*
Operation nest
Wildcard kubernetes_*
Nest_under kubernetes
Remove_prefix kubernetes_
[Output]
Name http
Match *
host logstash.sometest.svc.cluster.local
port 5000
format json_lines
json_date_key logDate
json_date_format iso8601

parsers.conf:

[PARSER]
Name docker
Format json
Time_Key time
Time_Format %Y-%m-%dT%H:%M:%S.%L
Time_Keep true

Quick-start doesn't take effect when have installed other logging components like logging-stack.

As the title described, quick-start doesn't take effect when have installed other logging components like logging-stack.

This is not to say that there is a problem with the quick-start file, but that the name of fluentbit/fluentbitconfig and selectors is the same as logging-stack.

Since the problem occurs when applying or deleting the quick-start to the environment that has installed logging-stack or enabled KubeSphere logging components, it is not recommended to installing both components without pre-processing to the quick-start.

If you want to install both, pls do a pre-processing like follows:

apiVersion: logging.kubesphere.io/v1alpha2
kind: FluentBit
metadata:
  name: fluent-bit-quickstart
  namespace: kubesphere-logging-system
  labels:
    app.kubernetes.io/name: fluent-bit
spec:
  image: kubesphere/fluent-bit:v1.8.3
  fluentBitConfigName: fluent-bit-config-quickstart

---
apiVersion: logging.kubesphere.io/v1alpha2
kind: FluentBitConfig
metadata:
  name: fluent-bit-config-quickstart
  namespace: kubesphere-logging-system
  labels:
    app.kubernetes.io/name: fluent-bit
spec:
  inputSelector:
    matchLabels:
      quickstart.logging.kubesphere.io/enabled: "true"
  outputSelector:
    matchLabels:
      quickstart.logging.kubesphere.io/enabled: "true"
---
apiVersion: logging.kubesphere.io/v1alpha2
kind: Input
metadata:
  name: dummy
  namespace: kubesphere-logging-system
  labels:
    quickstart.logging.kubesphere.io/enabled: "true"
spec:
  dummy:
    tag: my_dummy

---
apiVersion: logging.kubesphere.io/v1alpha2
kind: Output
metadata:
  name: stdout
  namespace: kubesphere-logging-system
  labels:
    quickstart.logging.kubesphere.io/enabled: "true"
spec:
  match: "*"
  stdout: {}

@FeynmanZhou

Support autoscaling for fluentd instance.

Add an autoscale field to implement the logic for auto HPA operators with horizontalpodautoscalers.

/assgin @zhu733756

Unable to collect the logs when the DOCKER ROOT DIR is not consistent with different nodes

1、fluent-bit 采集容器标准输出日志时，挂载的宿主机目录为 /var/log/

apiVersion: v1
kind: Pod
metadata:
  name: fluent-bit-46b47
spec:
  containers:
    volumeMounts:
    - mountPath: /var/log/
      name: varlogs
      readOnly: true
  volumes:
  - hostPath:
      path: /var/log
      type: ""
    name: varlogs

fluent-bit Input tail 插件采集日志的目录为 /var/log/containers/*.log

[Input]
    Name    tail
    Path    /var/log/containers/*.log

/var/log/containers 目录中的文件实际上都是软链接，它指向的 /var/log/pods 目录，而 /var/log/pods/*/*.log 文件也都是软链接，最终指向的是 DOCKER_ROOT_DIR/containers/*/*.log

这个 DOCKER_ROOT_DIR/containers 目录也会挂载到 fluent-bit 容器中

apiVersion: v1
kind: Pod
metadata:
  name: fluent-bit-46b47
spec:
  containers:
    volumeMounts:
    - mountPath: /var/lib/docker/containers
      name: varlibcontainers
  volumes:
  - hostPath:
      path: /var/lib/docker/containers
      type: ""
    name: varlibcontainers

2、fluent-bit 容器中的挂载的 DOCKER_ROOT_DIR 目录是从 fluentbit-operator 容器所在的宿主机获取的

apiVersion: v1
kind: Pod
metadata:
  name: fluentbit-operator-78fc579f6-crrt5
spec:
  initContainers:
  - command:
    - /bin/sh
    - -c
    - set -ex; echo DOCKER_ROOT_DIR=$(docker info -f {{.DockerRootDir}}) > /fluentbit-operator/fluent-bit.env

3、当某个 worker 节点的 DOCKER_ROOT_DIR 与 fluentbit-operator 所在的宿主机不一致时，这个 worker 节点的容器日志将无法采集

例如：

fluentbit-operator 所在的宿主机的 DOCKER_ROOT_DIR 为 /var/lib/docker
某个 worker 节点的 DOCKER_ROOT_DIR 为 /home/docker

此时这个 worker 节点 /var/log/pods/*/*.log 软链接文件指向的是 /home/docker/containers/*/*.log ，fluent-bit 容器中找不到 /home/docker/containers/*/*.log 文件

原因是这个 worker 节点对应的 fluent-bit 容器挂载的 DOCKER_ROOT_DIR/containers 是 fluentbit-operator 所在的宿主机获取到的 /var/lib/docker/containers，而不是 /home/docker/containers

4、有什么办法可以让 fluent-bit 容器挂载的 DOCKER_ROOT_DIR 为所在节点 dockerd 的 DOCKER_ROOT_DIR 吗？

operator YAML including the status field

The fluent-bit operator setup YAML (the version I got, at https://raw.githubusercontent.com/kubesphere/fluentbit-operator/release-0.8/manifests/setup/setup.yaml) includes the status field in the resources:

status:
  acceptedNames:
    kind: ""
    plural: ""
  conditions: []
  storedVersions: []

AFAIK, this is not needed because the status will be set by the kube apiserver ?

With 'normal' kubectl apply it doesn't really matter, I think, but in some cases it might (I saw a problem when deploying through terraform kubernetes_manifest for example)

Input include a not exist path, tail input not working at all

I add a custom path input like /var/log/<mypath>/*/*, then this path is not exist in some kubernetes node.
fluent bit output warn & error log info, and fluent bit does not output any thing. It is not correct.

Add a doc to elaborate on installing fluentbit-operator on existing K8s cluster

Please add a doc to elaborate on installing fluentbit-operator on existing K8s cluster

Missing ClusterFluentBitConfig, ClusterOutput and ClusterInput from the manifests/setup directory

When starting the manager, I get missing CRDs errors, but I cannot find those in the repository.

Missing:

ClusterFluentBitConfig
ClusterOutput
ClusterInput

I used make manifests and I cannot find these CRDs in the output, is this expected ?

They are listed (Cluster* and non Cluster) in the config/crd/bases directory.

After further searching, I can see that the non Cluster-prefix are present in manifests/setup/fluent-operator-crd.yaml, but not the Cluster* prefix (With Cluster scope). This is misleading. I can only speculate that the transformation from bases removes the Cluster* kinds.

Is it wanted to keep both ? If yes, I think that the non Cluster prefixed are of the wrong scope (shouldn't they be of Namespace scope ?).

Also, in the charts I can only find the non Cluster-prefixed crds, But the have the Cluster scope.

Kubernetes plugin neither annotating nor logging errors

Hi there folks,

Not certain if this is a fluentbit-operator problem or a general fluentbit kubernetes filter plugin issue...

I've implemented the operator using helm into a namespace called 'logging', using images kubesphere:operator:fluentbit-operator:v0.12.0 and kubesphere/fluent-bit:v1.8.3; it's using the standard input (docker, kubelet and tail) and filter (containerd, kubernetes and systemd) resources along with the fluentd output resource (as defined by the helm chart) to forward logs to a fluentd statefulset aggregator where, for debugging, I'm currently using only the in_forward and out_file plugins.

The container logs in the 'logging' namespace are being annotated correctly - I'm seeing logs from other containers (I'm running a log-generating pod in another namespace called 'flogger').

Logs relating to the kubernetes filter from the fluent-bit pods look like this (here's one, the other is identical):
 kubectl logs fluent-bit-k76wd | grep filter [2021/10/02 03:36:10] [ info] [filter:kubernetes:kubernetes.2] https=1 host=kubernetes.default.svc port=443 [2021/10/02 03:36:10] [ info] [filter:kubernetes:kubernetes.2] local POD info OK [2021/10/02 03:36:10] [ info] [filter:kubernetes:kubernetes.2] testing connectivity with API server... [2021/10/02 03:36:10] [ info] [filter:kubernetes:kubernetes.2] connectivity OK [2021/10/02 03:47:28] [ info] [filter:kubernetes:kubernetes.1] https=1 host=kubernetes.default.svc port=443 [2021/10/02 03:47:28] [ info] [filter:kubernetes:kubernetes.1] local POD info OK [2021/10/02 03:47:28] [ info] [filter:kubernetes:kubernetes.1] testing connectivity with API server... [2021/10/02 03:47:28] [ info] [filter:kubernetes:kubernetes.1] connectivity OK [2021/10/02 03:58:25] [ info] [filter:kubernetes:kubernetes.1] https=1 host=kubernetes.default.svc port=443 [2021/10/02 03:58:25] [ info] [filter:kubernetes:kubernetes.1] local POD info OK [2021/10/02 03:58:25] [ info] [filter:kubernetes:kubernetes.1] testing connectivity with API server... [2021/10/02 03:58:25] [ info] [filter:kubernetes:kubernetes.1] connectivity OK

There are quite a few error logs that mention the flogger pod logs:
[2021/10/02 03:36:34] [error] [plugins/in_tail/tail_file.c:1289 errno=2] No such file or directory [2021/10/02 03:36:34] [error] [plugins/in_tail/tail_fs_inotify.c:139 errno=2] No such file or directory [2021/10/02 03:36:34] [error] [input:tail:tail.2] inode=352325017 cannot register file /var/log/containers/flogger-79fb55496c-wsck9_cat_flog-404e6754d7eeb58210e94e41eabc554faf8a70799182a7b57b61155704b9de56.log [2021/10/02 03:36:35] [error] [plugins/in_tail/tail_file.c:1289 errno=2] No such file or directory [2021/10/02 03:36:35] [error] [plugins/in_tail/tail_fs_inotify.c:139 errno=2] No such file or directory [2021/10/02 03:36:35] [error] [input:tail:tail.2] inode=352325073 cannot register file /var/log/containers/flogger-79fb55496c-wsck9_cat_flog-404e6754d7eeb58210e94e41eabc554faf8a70799182a7b57b61155704b9de56.log

Can anyone advise?

Multiple path is not supported

Only one path is supported here
https://github.com/fluent/fluentbit-operator/blob/4b96fcc0a7e19a5bb89f7051982d7bcee538b2a2/api/fluentbitoperator/v1alpha2/plugins/input/tail_types.go#L28

But as documented in fluentbit doc

Pattern specifying a specific log file or multiple ones through the use of common wildcards. Multiple patterns separated by commas are also allowed.

Seem like Makefile run command not correct

I just got the error when i run make run.

...
kustomize build manifests/setup | sed -e '/creationTimestamp/d' > manifests/setup/setup.yaml
go run ./main.go
stat ./main.go: no such file or directory
make: *** [run] Error 1

May be cmd/manager/main.go not ./main.go ?

run: generate fmt vet manifests
	go run ./main.go

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.

fluent / fluent-operator Goto Github PK

fluent-operator's Introduction

Fluent Operator

Table of contents

Overview

Fluent Bit

Fluentd

Get Started

Prerequisites

Install

Deploy Fluent Operator with YAML

Deploy Fluent Operator with Helm

Fluent Operator Walkthrough

Collect Kubernetes logs

Deploy the Kubernetes logging stack with YAML

Deploy the Kubernetes logging pipeline with Helm

Collect audit logs

Fluentd

Plugins

Fluent Bit

Fluentd

Best Practice

Plugin Grouping

Monitoring

Custom Parser

Misc

Custom Plugin

Roadmap

Development

Requirements

Running

Contributing

Documentation

Manifests

Community

About the community

Contact us

Videos and blogs

fluent-operator's People

Contributors

Stargazers

Watchers

Forkers

fluent-operator's Issues

Hi, When elasticsearch output "index" is defined, it performs the conversion as "host" inside. es-output.yaml

Recommend Projects

Recommend Topics

Recommend Org

Hi, When elasticsearch output "index" is defined, it performs the conversion as "host" inside.
es-output.yaml