PPLNN, which is short for "PPLNN is a Primitive Library for Neural Network", is a high-performance deep-learning inference engine for efficient AI inferencing. It can run various ONNX models and has better support for OpenMMLab.

• Installing prerequisites:

  • On Debian or Ubuntu:

  apt-get install build-essential cmake git python3 python3-dev

  • On RedHat or CentOS:

  yum install gcc gcc-c++ cmake3 make git python3 python3-devel

• Cloning source code:

git clone https://github.com/openppl-public/ppl.nn.git

• Building from source:

cd ppl.nn
./build.sh -DHPCC_USE_X86_64=ON -DPPLNN_ENABLE_PYTHON_API=ON

• Running python demo:

PYTHONPATH=./pplnn-build/install/lib python3 ./tools/pplnn.py --use-x86 --onnx-model tests/testdata/conv.onnx

Refer to Documents for more details.

• Ops and Models
  • Supported Precison
  • Supported Ops and Platforms
  • Converting ONNX Opset
  • Generating ONNX models from OpenMMLab
• Building from Source
• APIs
  • C++
    • Getting Started
    • API Reference
  • Python
    • Getting Started
    • API Reference
  • Lua
    • Getting Started
    • API Reference
• Develop Guide
  • Adding New Engines and Ops
  • X86
    • Adding Ops（中文版）
    • Benchmark（中文版）
  • CUDA
    • Adding Ops（中文版）
    • Benchmark（中文版）

Questions, reports, and suggestions are welcome through GitHub Issues!

WeChat Official Account	QQ Group
OpenPPL	627853444

This project uses Contributor Covenant as code of conduct. Any contributions would be highly appreciated.

• onnxruntime
• onnx
• openvino
• oneDNN
• TensorRT
• OpenMMLab

This project is distributed under the Apache License, Version 2.0.