z103cb Goto Github PK

caikit-nlp-client

instascale

On-demand Kubernetes/OpenShift cluster scaling and aggregated resource provisioning

kuberay

A toolkit to run Ray applications on Kubernetes

kueue

Kubernetes-native Job Queueing

modelmesh-minio-examples

ModelMesh example models packaged into a MinIO container for user exploration and functional verification testing

multi-cluster-app-dispatcher

A fork of Codelfare's MCAD (a Holistic job manager on Kubernetes). This fork is meant to explore alternate ideas for implementing the same ideas.

opendatahub_vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

openshift_release

Release tooling for OpenShift

openvino-repo-syncher

openvino_model_server

A scalable inference server for models optimized with OpenVINO™

repo-syncher

sync-upstream-repo

Github action: Sync and merge upstream repository with your current repository

training-operator

Training operators on Kubernetes.

triton_common

Common source, scripts and utilities shared across all Triton repositories.

triton_core

The core library and APIs implementing the Triton Inference Server.

triton_repeat_backend

An example Triton backend that demonstrates sending zero, one, or multiple responses for each request.

triton_third_party

Third-party source packages that are modified for use in Triton.