Parseable Collector is an automatic log collection system for Parseable. Collector is designed to pull application logs from specific containers (using Kubernetes API). Collector sends collected logs to Parseable server for storage, querying and further analysis.

Log collection has been traditionally done with agents installed on each Kubernetes node. This is too much of installation and compute overhead for most of the use cases. In reality, developers simply want to plug their applications to logging and move on. Collector is designed keeping this in mind.

With Collector we set out to achieve the shortest path between application generating logs and developer analysing those logs.

Collector is designed to run on Kubernetes only. We recommend installing Collector via the official helm chart available in this repository. Before deploying the collector, make sure you understand the configuration.

Collector takes configuration input in yaml format.

logStreams:
  - name: backend
    collectionInterval: 3s
    collectFrom: 
      namespace: streaming
      podSelector: 
        app: kafka
    labels: 
      app: kafka
      namespace: streaming