Project bringing Kubeflow Pipelines and Tekton together. The project is driven according to this design doc. The current code allows you run Kubeflow Pipelines with Tekton backend end to end.

• Create your Pipeline using Kubeflow Pipelines DSL, and compile it to Tekton YAML.
• Upload the compiled Tekton YAML to KFP engine (API and UI), and run end to end with logging and artifacts tracking enabled.

For more details about the project, including demos, please look at these slides and the deep dive presentation.

The Tekton Pipelines project provides Kubernetes-style resources for declaring CI/CD-style pipelines. Tekton introduces several new Custom Resource Definitions (CRDs) including Task, Pipeline, TaskRun, and PipelineRun. A PipelineRun represents a single running instance of a Pipeline and is responsible for creating a Pod for each of its Tasks and as many containers within each Pod as it has Steps. Please look for more details in Tekton repo.

We are currently using Kubeflow Pipelines 1.0.0 and Tekton >= 0.14.0 for this project.

Install Kubeflow Pipelines with Tekton backend

Use KFP Tekton SDK

Run Samples

Available KFP DSL Features

Backend Developer Guide

SDK Developer Guide

Compilation Tests Status Report

Design Doc

KFP, Argo and Tekton Features Comparison

Kubeflow Slack

CD Foundation MLOps Sig.

Instructions to join

Kubeflow and TFX Pipelines

Kubeflow and TFX Pipelines talk at Tensorflow World