See the latest Release Notes.


nGraph is an open-source C++ library, compiler stack, and runtime accelerator for software engineering in the Deep Learning ecosystem. nGraph simplifies development and makes it possible to design, write, compile, and deploy Deep Neural Network-based solutions that can be adapted and deployed across many frameworks and backends. A more detailed explanation, as well as a high-level overview, can be found on our project Architecture, Features, FAQs. For more generalized discussion on the ecosystem, see the ecosystem document.

Quick Start

We have many documentation pages to help you get started.

Framework Bridge Available? ONNX Support?
TensorFlow Yes Yes
MXNet Yes Yes
PaddlePaddle Coming Soon Yes
PyTorch No Yes
Other Write your own Custom
Backend Current support Future nGraph support
Intel® Architecture Processors (CPUs) Yes Yes
Intel® Nervana™ Neural Network Processor (NNPs) Yes Yes
Intel® Architecture GPUs Yes Yes
AMD* GPUs via PlaidML Yes
Field Programmable Gate Arrays (FPGAs) Coming soon Yes
NVIDIA* GPUs via PlaidML Some
Intel Movidius™ Myriad™ 2 (VPU) Coming soon Yes


The code in this repo is under active development as we’re continually adding support for more kinds of DL models and ops, compiler optimizations, and backend optimizations.

Indices and tables