jishminor Goto Github PK

atomic

Wrapper types for sync/atomic which enforce atomic access

backend

Common source, scripts and utilities for creating Triton backends.

client

Triton Python and C++ client libraries and example, and client examples for go, java and scala.

common

Common source, scripts and utilities shared across all Triton repositories.

core

cpu

cpu command in Go, inspired by the Plan 9 cpu command

docker-slim

DockerSlim (docker-slim): Don't change anything in your Docker container image and minify it by up to 30x (and for compiled languages even more) making it secure too! (free and open source)

ee445l-linux

Setup repository for completing labs in ee445l on linux

ee445l_web

All things web for 445l

fluent-plugin-prometheus

A fluent plugin that collects metrics and exposes for Prometheus.

kubefed

Kubernetes Cluster Federation

llama.cpp

Port of Facebook's LLaMA model in C/C++

model_analyzer

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

papi

perfsage

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

tool-solutions

Tutorials & examples for Arm software development tools.

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators