wangyems Goto Github PK

benchmarkenv

A Docker based testing environment for benchmarking ONNXRuntime(ORT) CUDA Execution Provider, ORT TensorRT Execution Provider and Nvidia FasterTransformer

caffe

Please use https://github.com/BVLC/caffe as the main repo.

cast_removel_example

cppcoreguidelines

The C++ Core Guidelines are a set of tried-and-true guidelines, rules, and best practices about coding in C++

featurizerslibrary

A library of cross-platform, cross-framework, cross-programming language featurizers (operations in a data processing pipeline) that can be used during Machine Learning training and prediction activities.

onnx

Open standard for machine learning interoperability

onnxruntime

ONNX Runtime: cross-platform, high performance scoring engine for ML models

ortcustomoplibrary

A standalone code repository to generate dynamic library files for custom OnnxRuntime operators.

phi2

tensorrt

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

triton

Development repository for the Triton language and compiler

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs