Topic: pipeline Goto Github

Some thing interesting about pipeline

👇 Here are 4813 public repositories matching this topic...

airbytehq / airbyte

pipeline,The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Organization: airbytehq

Home Page: https://airbyte.com

data pipeline data-analysis data-engineering java python etl change-data-capture data-collection data-integration

alibaba / dawn

pipeline,:sunrise: Dawn is a lightweight task management and build tool for front-end and nodejs.

Organization: alibaba

Home Page: https://alibaba.github.io/dawn/

build-tool build front-end dawn dawn-cli task pack pipeline middleware construction

alibaba / pipcook

pipeline,Machine learning platform for Web developers

Organization: alibaba

Home Page: https://alibaba.github.io/pipcook/

js machine-learning tensorflow pipeline

alirezadir / production-level-deep-learning

pipeline,A guideline for building practical production-level deep learning systems to be deployed in real world applications.

User: alirezadir

machine-learning deep-learning pipeline scalable-applications production-system tfx kubeflow artificial-intelligence ai practical-machine-learning

apptension / saas-boilerplate

pipeline,SaaS Boilerplate - Open Source and free SaaS stack that lets you build SaaS products faster in React, Django and AWS. Focus on essential business logic instead of coding repeatable features!

Organization: apptension

Home Page: https://apptension.com/saas-boilerplate

cdk stack boilerplate frontend backend workers pipeline django docker saas

argoproj / argo-cd

pipeline,Declarative Continuous Deployment for Kubernetes

Organization: argoproj

Home Page: https://argo-cd.readthedocs.io

argo argo-cd cd ci-cd cicd continuous-delivery continuous-deployment devops docker gitops hacktoberfest helm ksonnet kubernetes pipeline

avaiga / taipy

pipeline,Turns Data and AI algorithms into production-ready web applications in no time.

Organization: avaiga

Home Page: https://www.taipy.io

automation data-engineering data-ops data-visualization datascience developer-tools mlops orchestration pipeline pipelines

axelderomblay / mlbox

pipeline,MLBox is a powerful Automated Machine Learning python library.

User: axelderomblay

Home Page: https://mlbox.readthedocs.io/en/latest/

machine-learning auto-ml kaggle deep-learning stacking pipeline optimization preprocessing encoding prediction distributed xgboost drift classification regression lightgbm keras automated-machine-learning automl data-science

bloodaxe / pytorch-toolbelt

pipeline,PyTorch extensions for fast R&D prototyping and Kaggle farming

User: bloodaxe

pytorch kaggle image-classification image-segmentation deep-learning segmentation python image-processing machine-learning focal-loss

brunch / brunch

pipeline,:fork_and_knife: Web applications made easy. Since 2011.

Organization: brunch

Home Page: https://brunch.io

javascript workflow build-automation pipeline brunch

chunelfeng / cgraph

pipeline,【A common used C++ DAG framework】一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork

User: chunelfeng

Home Page: http://www.chunel.cn

dag threadpool workflow taskflow cpp concurrency pipeline framework mediapipe ros2

edyoda / data-science-complete-tutorial

pipeline,For extensive instructor led learning

Organization: edyoda

Home Page: https://www.edyoda.com/program/data-scientist-program

machine-learning scikit-learn linear-regression nearest-neighbors feature-selection decision-trees numpy pandas pipeline

entilzha / pyfunctional

pipeline,Python library for creating data pipelines with chain functional programming

User: entilzha

Home Page: http://pyfunctional.pedro.ai

python datascience pipeline data functional-programming

epicgamesext / blendertools

pipeline,Blender addons that improve the game development workflow between Blender and Unreal.

Organization: epicgamesext

Home Page: https://epicgamesext.github.io/BlenderTools/

blender blender-addon pipeline python unreal

firecow / gitlab-ci-local

pipeline,Tired of pushing to test your .gitlab-ci.yml?

User: firecow

gitlab local pipeline git ci cd push untracked uncomitted gitlab-ci

gaia-pipeline / gaia

pipeline,Build powerful pipelines in any programming language.

Organization: gaia-pipeline

automation build continuous-delivery continuous-integration continuous-testing cplusplus deployment devops devops-tools distributed-systems gitops go java kubernetes pipeline python ruby

galaxyproject / galaxy

pipeline,Data intensive science for everyone.

Organization: galaxyproject

Home Page: https://galaxyproject.org

bioinformatics workflow genomics science sequencing ngs dna usegalaxy pipeline workflow-engine

gonglei007 / gamedevmind

pipeline,最全面的游戏开发技术图谱。帮助游戏开发者们在已知问题上节省时间，省出更多的精力投入到更有创造性的工作中去。

User: gonglei007

3d cpp devops framework game game-development game-framework game-server gamedev management mmorpg pipeline programming roadmap scrum shader unity unity3d unreal-engine unrealengine

google / xls

pipeline,XLS: Accelerated HW Synthesis

Organization: google

Home Page: http://google.github.io/xls/

compiler high-level-synthesis hls open-source pipeline verilog mid-level-synthesis

googlecloudplatform / vertex-ai-samples

pipeline,Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.

Organization: googlecloudplatform

Home Page: https://cloud.google.com/vertex-ai

samples google-cloud-platform vertex-ai notebook ml genai generative-ai vertexai model-garden colab

great-expectations / great_expectations

pipeline,Always know what to expect from your data.

Organization: great-expectations

Home Page: https://docs.greatexpectations.io/

pipeline-tests dataquality datacleaning datacleaner data-science data-profiling pipeline pipeline-testing cleandata dataunittest

pipeline,[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

User: hu17889

spider crawler go schedule pipeline

iam-veeramalla / jenkins-zero-to-hero

pipeline,Install Jenkins, configure Docker as slave, set up cicd, deploy applications to k8s using Argo CD in GitOps way.

User: iam-veeramalla

Home Page: https://www.youtube.com/@AbhishekVeeramalla

argocd cicd docker gitops jenkins kubernetes pipeline

instill-ai / instill-core

pipeline,🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications

Organization: instill-ai

Home Page: https://www.instill.tech

unstructured-data low-code developer-tools etl no-code open-source hacktoberfest ai api cli generative-ai golang gpt llm pipeline python stable-diffusion typescript

internlm / huixiangdou

pipeline,HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance

Organization: internlm

application assistance chatbot dsl lark llm multimodal ocr pipeline rag robot wechat

jenkins-x / jx

pipeline,Jenkins X provides automated CI+CD for Kubernetes with Preview Environments on Pull Requests using Cloud Native pipelines from Tekton

Organization: jenkins-x

Home Page: https://jenkins-x.io/

kubernetes cicd continuous-integration continuous-delivery accelerator openshift gitops environments pipeline devops golang tekton hacktoberfest

jina-ai / jina

pipeline,☁️ Build multimodal AI applications with cloud-native stack

Organization: jina-ai

Home Page: https://docs.jina.ai

neural-search cloud-native deep-learning machine-learning framework grpc kubernetes multimodal mlops pipeline

juliaai / mlj.jl

pipeline,A Julia machine learning framework

Organization: juliaai

Home Page: https://juliaai.github.io/MLJ.jl/

machine-learning julia pipelines tuning data-science tuning-parameters predictive-modeling classification regression statistics clustering stacking ensemble-learning pipeline

kedro-org / kedro

pipeline,Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

Organization: kedro-org

Home Page: https://kedro.org

pipeline kedro hacktoberfest mlops experiment-tracking python machine-learning machine-learning-engineering

kestra-io / kestra

pipeline,Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

Organization: kestra-io

Home Page: https://kestra.io

data data-engineering data-integration data-orchestration data-orchestrator data-pipeline data-quality elt etl low-code orchestration pipeline reverse-etl scheduler workflow workflow-engine

kubeflow / pipelines

pipeline,Machine Learning Pipelines for Kubeflow

Organization: kubeflow

Home Page: https://www.kubeflow.org/docs/components/pipelines/

kubeflow-pipelines mlops kubeflow machine-learning kubernetes pipeline data-science

lastbackend / lastbackend

pipeline,System for containerized apps management. From build to scaling.

Organization: lastbackend

Home Page: https://lastbackend.com

cloud docker hosting continuous-delivery continuous-integration backend go golang containers lastbackend

mage-ai / mage-ai

pipeline,🧙 Build, run, and manage data pipelines for integrating and transforming data.

Organization: mage-ai

Home Page: https://www.mage.ai/

machine-learning artificial-intelligence data data-engineering data-science python elt etl pipelines data-pipelines

mara / mara-pipelines

pipeline,A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Organization: mara

data data-integration etl pipeline postgresql python

marimo-team / marimo

pipeline,A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.

Organization: marimo-team

Home Page: https://marimo.io

notebooks python data-science machine-learning artificial-intelligence data-visualization developer-tools reactive pipeline web-app

moby / datakit

pipeline,Connect processes into powerful data pipelines with a simple git-like filesystem interface

Organization: moby

datakit filesystem-api data-flow database docker pipeline

nextflow-io / nextflow

pipeline,A DSL for data-driven computational pipelines

Organization: nextflow-io

Home Page: http://nextflow.io

bioinformatics workflow-engine pipeline pipeline-framework nextflow cloud groovy sge slurm aws

nteract / papermill

pipeline,📚 Parameterize, execute, and analyze notebooks

Organization: nteract

Home Page: http://papermill.readthedocs.io/en/latest/

julia jupyter notebook notebook-generator notebooks nteract pipeline publishing python r scala

prefecthq / prefect

pipeline,Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Organization: prefecthq

Home Page: https://prefect.io

python workflow data-engineering data-science workflow-engine prefect infrastructure ml-ops data-ops automation

projectdiscovery / httpx

pipeline,httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.

Organization: projectdiscovery

Home Page: https://docs.projectdiscovery.io/tools/httpx

http bugbounty ssl-certificate pipeline pentest-tool cybersecurity osint hacktoberfest cli lib

prql / prql

pipeline,PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

Organization: prql

Home Page: https://prql-lang.org

data pipeline sql

reugn / go-streams

pipeline,A lightweight stream processing library for Go

User: reugn

Home Page: https://pkg.go.dev/github.com/reugn/go-streams

stream-processing pipeline etl kafka data-stream kafka-streams streams redis pulsar data-pipeline

ropensci / drake

pipeline,An R-focused pipeline toolkit for reproducibility and high-performance computing

Organization: ropensci

Home Page: https://docs.ropensci.org/drake

reproducibility high-performance-computing r data-science drake makefile pipeline workflow reproducible-research rstats

scipipe / scipipe

pipeline,Robust, flexible and resource-efficient pipelines using Go and the commandline

Organization: scipipe

Home Page: https://scipipe.org

scientific-workflows bioinformatics-pipeline workflow go dataflow pipeline cheminformatics bioinformatics fbp scipipe

tc39 / proposal-pipeline-operator

pipeline,A proposal for adding a useful pipe operator to JavaScript.

Organization: tc39

Home Page: http://tc39.github.io/proposal-pipeline-operator/

javascript tc39 proposal pipeline operator syntax

tektoncd / pipeline

pipeline,A cloud-native Pipeline resource.

Organization: tektoncd

Home Page: https://tekton.dev

tekton pipeline kubernetes cdf hacktoberfest

tencentmusic / cube-studio

pipeline,cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式

Organization: tencentmusic

kubernetes inference mlops workflow ai pytorch spark argo kubeflow automl