jfrog / log-analytics-elastic Goto Github PK

Hey,

This is a very interesting initiative, which raises a few questions

• Is this project for demo purposes, or will it have a greater purpose? Unified support, analytics, monitoring etc
• we are running the medium size of the enterprise Artifactory and currently using filebeat to push logs to elastic search, should we consider to replace the current setup with this one?
• I would like to question unified-artifactory elastic search index, in the fluentd configuration. - nature and log scheme for different logs in artifactory have a very different nature. For example, console.log and access logs scheme have almost nothing in common, is it wise and does it make sense to put all logs into a single elastic search index?
• in the current fluentd configuration, currently, there is no timestamp in the index name - which almost makes impossible for effective log lifecycle (rotation and cleanup)

Hey,

This is a very interesting initiative, which raises a few questions

• Is this project for demo purposes, or will it have a greater purpose? Unified support, analytics, monitoring etc
• we are running the medium size of the enterprise Artifactory and currently using filebeat to push logs to elastic search, should we consider to replace the current setup with this one?
• I would like to question unified-artifactory elastic search index, in the fluentd configuration. - nature and log scheme for different logs in artifactory have a very different nature. For example, console.log and access logs scheme have almost nothing in common, is it wise and does it make sense to put all logs into a single elastic search index?
• in the current fluentd configuration, currently, there is no timestamp in the index name - which almost makes impossible for effective log lifecycle (rotation and cleanup)

Hi , Team,

We are not able to deploy here as high-qos-limit-requests not specified. Can you please change the https://github.com/jfrog/log-analytics-elastic/blob/master/helm/artifactory-ha-values.yaml to include the resources spec for three containers download-fluentd-conf-on-persistent-volume/prepare-fluentd-conf-on-persistent-volume/artifactory-fluentd-sidecar?

14m Warning FailedCreate statefulset/artifactory-ha-stg-artifactory-ha-primary create Pod artifactory-ha-stg-artifactory-ha-primary-1 in StatefulSet artifactory-ha-stg-artifactory-ha-primary failed error: pods "artifactory-ha-stg-artifactory-ha-primary-1" is forbidden: failed quota: high-qos-limit-requests: must specify limits.cpu,limits.memory,requests.cpu,requests.memory

70s Warning FailedCreate statefulset/artifactory-ha-stg-artifactory-ha-primary create Pod artifactory-ha-stg-artifactory-ha-primary-0 in StatefulSet artifactory-ha-stg-artifactory-ha-primary failed error: pods "artifactory-ha-stg-artifactory-ha-primary-0" is forbidden: failed quota: high-qos-limit-requests: must specify limits.cpu,limits.memory,requests.cpu,requests.memory

sts template we followed is from here :

https://github.com/jfrog/charts/blob/master/stable/artifactory-ha/templates/artifactory-primary-statefulset.yaml

The sts values output currently is:
name: download-fluentd-conf-on-persistent-volume
resources: {}

    name: prepare-fluentd-conf-on-persistent-volume
    resources: {}

    name: artifactory-fluentd-sidecar
    resources: {}

Thanks
Yi

Hi team,

We are trying to deploy the fluentd agent but blocked here with wget github content (may firewall issue), so we are trying to mount the fluentd.conf as configmap as following, but it failed to

Connecting to raw.githubusercontent.com (185.199.110.133:443)
wget: can't connect to remote host (185.199.110.133): Connection refused

artifactory-ha-values.yaml (download-fluentd-conf-on-persistent-volume) change to following but does not work:

  2 artifactory:
  3   customInitContainersBegin: |
  4     - name: "download-fluentd-conf-on-persistent-volume"
  5       image: "{{ .Values.initContainerImage }}"
  6       imagePullPolicy: "{{ .Values.artifactory.image.pullPolicy }}"
  7       volumeMounts:
  8         - mountPath: "{{ .Values.artifactory.persistence.mountPath }}"
  9           name: volume
 10         - mountPath: "{{ .Values.artifactory.persistence.mountPath }}"/etc/fluentd/fluentd.conf
 11           name: fluentd
 12   volumes:
 13   - name: fluentd
 14     configMap:
 15       name: fluent-conf

Error: failed to parse artifactory-ha-values.yaml: error converting YAML to JSON: yaml: line 15: did not find expected key
helm.go:81: [debug] error converting YAML to JSON: yaml: line 15: did not find expected key
failed to parse artifactory-ha-values.yaml

Wondering if you can help us to achieve that.Thanks in advance.