Tengine, developed by OPEN AI LAB, is an AI application development platform for AIoT scenarios launched by OPEN AI LAB, which is dedicated to solving the fragmentation problem of aiot industrial chain and accelerating the landing of AI industrialization. Tengine is specially designed for AIoT scenarios, and it has several features, such as cross platform, heterogeneous scheduling, chip bottom acceleration, ultra light weight and independent, and complete development and deployment tool chain. Tengine is compatible with a variety of operating systems and deep learning algorithm framework, which simplifies and accelerates the rapid migration of scene oriented AI algorithm on embedded edge devices, as well as the actual application deployment;

Tengine is composed of five modules: core/operator/serializer/executor/driver.

• core provides the basic components and functionalities of the system.
• operator defines the schema of operators, such as convolution, relu, pooling, etc. al. Here is the current support operator list.
• serializer is to load the saved model. The serializer framework is extensible to support different format, including the customized one. Caffe/ONNX/Tensorflow/MXNet and Tengine models can be loaded directly by Tengine.
• executor implements the code to run graph and operators. Current version provides a highly optimized implementation for multi A72 cores.
• driver is the adapter of real H/W and provides service to device executor by HAL API. It is possible for single driver to create multiple devices.

please refer to Wiki

please visit examples for demos on classification/detection and download models from Tengine model zoo (psw: hhgc)

tengine applications is a project for sharing android/linux applications powered by Tengine

• Github issues
• QQ group: 829565581 (Question:Tengine Answer:openailab)
• email: [email protected]
• Tengine Community: http://www.tengine.org.cn/

Test on RK3399-1*A72

More Benchmark data to be added.

2020.4 updated

• More examples
• Netron support Tengine model .tmfile
• New compile configuration file
• Easy to use C++ API
• Easy to use Python API
• Support more ops of ONNX(PyTorch)

• x86 platform ops