See the latest Release Notes.

nGraph is an open-source C++ library, compiler stack, and runtime accelerator for software and neural network engineering within the Deep Learning ecosystem. nGraph simplifies development and makes it possible to design, write, compile, and deploy Deep Neural Network-based solutions that can be adapted and deployed across many frameworks and backends. See our project Architecture, Features, FAQs and ecosystem for more details.


The Intel nGraph Compiler stack supports a broad ecosystem of frameworks and backends.

Quick Start

We have many documentation pages to help you get started.

Framework Bridge Available? ONNX Support?
TensorFlow Yes Yes
MXNet Yes Yes
PaddlePaddle Coming Soon Yes
PyTorch No Yes
Other Write your own Custom
Backend Current support Future nGraph support
Intel® Architecture Processors (CPUs) Yes Yes
Intel® Nervana™ Neural Network Processor (NNPs) Yes Yes
Intel® Architecture GPUs Yes Yes
AMD* GPUs via PlaidML Yes
Field Programmable Gate Arrays (FPGAs) Coming soon Yes
NVIDIA* GPUs via PlaidML Some
Intel Movidius™ Myriad™ 2 (VPU) Coming soon Yes


The code in this repo is under active development as we’re continually adding support for more kinds of DL models and ops, compiler optimizations, and backend optimizations.

Indices and tables