PPLNN

Overview

PPLNN, which is short for "PPLNN is a Primitive Library for Neural Network", is a high-performance deep-learning inference engine for efficient AI inferencing. It can run various ONNX models and has better support for OpenMMLab.

Hello, world!

• Installing prerequisites:

  • On Debian or Ubuntu:

  apt-get install build-essential cmake git python3 python3-dev
  

  • On RedHat or CentOS:

  yum install gcc gcc-c++ cmake3 make git python3 python3-devel
  

• Cloning source code:

git clone https://github.com/openppl-public/ppl.nn.git

• Building from source:

cd ppl.nn
./build.sh -DPPLNN_USE_X86_64=ON -DPPLNN_ENABLE_PYTHON_API=ON

• Running python demo:

PYTHONPATH=./pplnn-build/install/lib python3 ./tools/pplnn.py --use-x86 --onnx-model tests/testdata/conv.onnx

Refer to Documents for more details.

Documents

• Building from Source
• How to Integrate
• APIs
  • C++
    • Getting Started
    • API Reference
  • Python
    • Getting Started
    • API Reference
• Develop Guide
  • Adding New Engines and Ops
  • X86
    • Supported Ops and Platforms
    • Adding Ops（中文版）
    • Benchmark（中文版）
  • CUDA
    • Supported Ops and Platforms
    • Adding Ops（中文版）
    • Benchmark（中文版）
  • RISCV
    • Supported Ops and Platforms
    • Adding Ops（中文版）
    • Benchmark（中文版）
  • ARM
    • Adding Ops（中文版）
    • Benchmark（中文版）
  • LLM-CUDA
    • Overview
• Models
  • Converting ONNX Opset
  • Generating ONNX models from OpenMMLab
• 实现细节

Contact Us

Questions, reports, and suggestions are welcome through GitHub Issues!

WeChat Official Account	QQ Group
OpenPPL	627853444

Contributions

This project uses Contributor Covenant as code of conduct. Any contributions would be highly appreciated.

Acknowledgements

• onnxruntime
• onnx
• openvino
• oneDNN
• TensorRT
• OpenMMLab

License

This project is distributed under the Apache License, Version 2.0.