Giter VIP home page Giter VIP logo

gsoc17-cncf's Introduction

Stories in Ready

Google Summer of Code 2017 - Standardizing Kubernetes Logs (CNCF)

Code before pondering. Multipurpose learning

🚀 Project tracker - Create and implement a data model to standardize Kubernetes logs (CNCF)

🙇Student Portfolio

🎉Links

Tasks :

  • 1st Evaluation Tasks [30th May - 30th June 2017]

    • Deploying OpenShift + Logging + ViaQ bits [ Skip MUX configuration]
    • Setting up common data model used by Elasticsearch and Kibana
    • Configuration of Fluentd with Testing
  • Mid Evaluation Tasks [30th June - 28th July 2017]

    • Creating Pods and its configuration
    • Setting up the pipeline into Elasticsearch
    • Configuring and streaming logs from Fluentd into Elasticsearch
    • Launch Elasticsearch as a replication controller
  • Final Evaluation Tasks [28th July - 21st August 2017]

    • Change easily fluentd pod configuration
    • Structuring Kubernetes logs
    • Create filter to rewrite "origin-node" and "origin-master" logs
    • Create filter with Kubernetes logs structure
    • Display Kubernetes components logs in Kibana

Demo!

GSoC with CNCF (Kubernetes)

Blog posts

Pull Requests and Issues

Repository: ViaQ

Total Pull Requests Created/Merged: 4

  1. ViaQ/Main#5 - Added Patch OpenShift Ansible
  2. ViaQ/Main#10 - Updated Fluentd Pod Config
  3. ViaQ/Main#21 - Update link [README-mux.md -> README-install.md]
  4. ViaQ/Relp#15 - Typo Fixed

Repository: OpenShift Origin

Total Pull Requests Created: 1

  1. openshift/origin-aggregated-logging#517 - Update to Fluentd and logging components

Total Issues Opened: 1

  1. openshift/origin-aggregated-logging#549 - Prometheus exporter to expose metrics from Elasticsearch

Repository: Kubernetes Incubator/Kubespray

Total Pull Requests Created/Merged: 1

  1. kubernetes-incubator/kubespray#1408 - Remove deprecated enable-cri flag in Kubernetes 1.7

Repository: Kubernetes

Total Issues Opened: 1

  1. kubernetes/kubernetes#51405 - Fluentd filter to process Kubernetes logs

gsoc17-cncf's People

Contributors

amitkumarj441 avatar waffle-iron avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

Forkers

waffle-iron

gsoc17-cncf's Issues

GSoC'17 2nd Evaluation

Second Evaluation Task

For detailed description Check README.md

  • Setup the pipeline into Elasticsearch and launch the Elasticsearch replication controller.

Find kubernetes logs in OpenShift

Find kubernetes logs in openshift such as logs for:

  • Kube Master
  • API access
  • Kubelet
  • Kube proxy
    and create a filter for them.
    If required change origin-node and/or origin-master for the appropriate field the log is coming from

Create filter for fluentd to rewrite kubernetes logs

Create filter for fluentd to rewrite kubernetes logs
"origin-node" --> kubernetes.node
"origin-master" --> kubernetes.master
... also
"atomic-openshift-node" --> kubernetes.node
"atomic-openshift-master" --> kubernetes.master

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.